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PREFACE 



This publication Is one of a series of technical evaluation reports 
Issued by the Korthvest Regional Educational Laboratory to document 
evaluation findings for selected products* The subject of this report 
l3 Relevant ExplovaHcm in Active Learning (SEAL), an Instructional 
resource developed In the Improving Teaching Competencies Program* 

This technical report presents the data collected about the use 
of SEAL In terms of strengths and weaknesses of the materials* It also 
focuses on the effects of SEAL participation on students and adults* 
This Information Is primarily summatlve In nature; It Includes perceptions 
of potential users concerning audiences as well as the strengths and 
veaknesses of SEAL and an account of how SEAL was used at a residential 
center for boys* 

The report has been reviewed by staff meabers of the Laboratory's 
Evaluation Coordination Unit* An Institutional technical revlw also 
has been conducted by Laboratory specialists external to the Program* 




Lawrence D* Fish 
Executive Director 
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INTRODUCTION 



This user review and case study report of Relevant Explorations in 
Active Learning (REAL) has been written In fulfillment of the contrac- 
tual agreements of the Improving Teaching Competencies Program (ITCF) 
of Northwest Regional Educational Laboratory (NWREL) with Its funding 
agency National Institute of Education (MIE), particularly those 
agreemnts relattd to the development and evaluation of REAL^ 

This report presents the design and results of two evaluation 
studies. The first was a users* review of REAL materials and the second 
a report of the tryout of RBAL as a resource at a residential treatment 
center for boys. The report contains five sections. In the first section 
PEAL Is briefly described and the purpose of the evaluation Is presented. 
The second and third sections describe procedures for the user review 
of REAL and the results of that review* The fourth section briefly 
suimnarlzes the case study of the use of REAL at Spauldlng Youth Center (S7C) 
In Tllton> New Hampshire. The fifth section contains recommendations 
based upon the two evaluation studies. 

HISTORY OF THE DEVELOPMENT OF REAL 

Development of REAL began In school year 1971-72 with the Johnson- 
O'Halley Special Project* funded by the State Department of Education of 
Washington state* At that time prototypes of the first six Mlnlpacs were 
created. In 1973 development of REAL began at NWREL. Set I was created 
that year> and work on Set II began In 1974* REAL was originally conceived 
as 52 comic boofc-llfoe sets. As the system evolved* however* each topic 
was expanded to Include both a variety of activities and a deeper consid- 
eration of the concepts Involved. The project finally resulted In two 



sets of seven Minlpacs each with both student and adult versions* A 
resource manual was developed In September 1975 to accompany the Set I 
of Minlpacs. 

Beginning In 1973» REAL was used by the developers In several 
schools In the Portland area for testing and refinement of the materials* 
Extensive testing of both sets was conducted In 1974 and 1975. The 
materials were used with both students and adults In Portland and £ugene> 
Oregon; In Seattle^ Tacoma» Klrkland and Vancouver^ Washington; and In 
Newport Beach> California* In these studies participants completed one 
set of Minlpacs. The evaluation looked for attitude and cognitive 
changes » necessary revisions in the material and teachers* attitudes 
toward REAL^ Results from these studies are reported in Interim Reports 
I and 11^^ 

DESCRIPTION OF THE SYSTEM 

The work unit producing Relevcatt E^lovaticna in Active Lecaming 

(REAL) had as Its planned activities the design* development and 

2 

evaluation of two sets of learning packages. Each set consisted of 
seven learning packages called Minlpacs* A Minlpac contained information 
about a specific **psycho-social** topic and provided a variety of learning 
experiences and self 'evaluation opportunities related to the topic* 



^iscox» Suzanne B* and Dale Rothlind. Relevant Eajploratione in Active 
Learning (REAL) Set J> Intevim Evaluation Report* Portland^ Oregon: 
Northwest Regional Educational Laboratory^ 1975. 

Hiscox» Suzanne B* and Dale Rothlind* Relevant Eajploratiohs in Active 
Learning (REAL) Set II, Interim Evaluation Report. Portland^ Oregon: 
Northwest Regional Educational Laboratory^ 1976. 

2 

The REAL materials will not be marketed labeled > Set I and Set II. 
Instead » the fourteen Minlpacs will each be available Independently 
without any set notation. 
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It was designed to help learners discover their present Ideas and 
behaviors In relation to the concepts or key Ideas presented In the 
Hlnlpac. 

The Hlnlpacs In Set I were titled: Feeling Dwnb, Getting the 
Meaning of the Message, Keeping Track of Tim, Being Influenced, Being 
Helped, Being Praised and Identifying My Seeds and Desires. The Set II 
Minlpecs were: Vhy Learn Anything?, Keeping Open to Learning, Learning 
on Your OtM, Letting Someone Teach ^ou. Strategies for Learning, Kiwbfing 
Your Om Learning Style and Learning by Ccnfrcntationa. 

According to the developers* each Minlpac was aimed at helping the 
participant understand and know what the self was becoming. This was to 
be accomplished through activities and content related to a particular 
psycho*soclal Issue or dynaialc which the developers believed to be 
confronted to some degree by all people at same time In their lives. 
Minlpacs vere intended to reorient participants' Interpretation and 
perceived meanlngfulness of commonly experienced events. 

Both adult and student versions of each Hlnlpac were developed. 
The content and activities In^the.two versions differed In otder to make 
thttn appropriate for the audiences. Individual and group versions of 
the student and adult Minlpacs also existed. That ls> there were four 
versions of each Minlpec: student Individual* student group* adult 
Individual and adult group. Components of the Minlpacs varied across 
the four versions. A description of the components found In each 
Minlpac follows: 
Directions 

The directions booklet contained a sequence of activities* some of 
which directed the participant to the other booklets In the Minlpac. 
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Kfty Ideas Bookl€t 

This booklet briefly presented the Mlnlpac topic In terms of Important 
psycho-social Ideas related to the Hlnlpac topic. 
Key Ideas Sheet 

As a reference for participants In worlclng through the Hlnlpac > 

this paper listed the key Ideas discussed In the Key Ideas Booklet. 
3 

Audio Cassette 

The tape contained Interviews* confrontations* fantasies and music 
Illustrative of the key Ideas as they appear In human experiences. 
Search Booklets 

There were two Search Booklets In each Set I Mlnlpac. In Search I, 
participants defined and reacted to the topic. In Search II, the 
participant recalled past experiences In analyzing his/her reactions to 
the .topic* In Set II > both searches were combined Into one booklet* 

SEAL may be used by high school students a? well as elementary and 
secondary school educational staff > Including teachers > administrators > 
counselors and paraprofesslonals* Student versions may form part of a 
classroom curriculum or act as counseling and guidance materials* For 
staff) REAL was designed for use In Inservlce workshops or Individual 
exploration* REAL was Intended to be used as a resource for both 
teachers and staff development personnel. 

GOALS OF REAL 

The general goals of REAL were as follows* The goals pertained to 
both student and adult materials In Set I and Set II* 
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Audiotapes will not be available In the published form* 
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The participants will: 



1. Relate key Id^as about psycho-aodal issuaa to parcaptlona 
of self as a learner (aelf-avarenaaa) » Incorporating the 
key Ideaa of the Minlpac in personal plans or objectives; 
thay vlll spadfy hov the key Ideas of a Minlpac relate 

to current needs » concerns or problems. 

2. Increase salf-nanaffement akllls and awareness regarding 
the self as a learner. Examples include: 

a. Specifying atrateglaa or procasaas used to apply 
Minlpac akllla to learning altuatlons 

b. Specifying criteria when making choices among 
atrateglea or procesaes to utilize in a learning 
situation 

c. Analyzing learning incidents in terms of the 
specific strateglee and choices Involved in the 
incident 

3. Derive naw Information about the self in terme of attitudes 
toward learning » their own needs and their ability to 
relate to peers. 



PURPOSE OP THE EVALUATION 

REAL was originally scheduled for completion in November 1976* ^ 
However » funding for the program vae cancelled in 1975 » necessitating 
earlier completion of the system. Because of the limitation of time and 
the resulting loss of funding for REALf as well as Information gathered 
during the interim phase of testings it wad decided that the bast purpose 
for the evalution would be to determine how the product » as it exieted» 
might be used by potential consumers. 

The evaluation of the REAL system served two main purposes: to 
determine whether people would use REAL (the student version in the 
classroom or in counseling situations and the adult version in staff 
development plans) and to see how REAL might be adapted to meet the 
needs of a specific user population (the Spauldlng Youth Center study) . 
To meet those purposes two means were employed: a review of the 
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materials by potential users of the system aad a field test of the materials 
at Spauldlng Youth Center In Tllton^ Mew Hampshire. 



EVALUATION QUESTIONS 

Individual questions for this evaluation were Intended to facilitate 
marketing and use of the system. Accordingly^ a major question 
involved the specific uses of the materials In a particular situation. 
Earlier testing of REAL had allowed minimal intervention or revision 
by teachers* The evaluator felt that users would want specific exaniples 
of adaptation of the material and users* reactions to REAL as a resource. 

Other evaluation questions were derived from an earlier expert 
review of Interpersoml Influence^ another ITCP product.* The expert 
review questions had been developed in cooperation with the HUREL Office 
of Dissemination and Xnatallatlon^ based upon judgments made by that 
office concerning Information needs of consumers and publishers. The 
following specific questions were addressed in the evaluation: 

1. Do potential consumers indicate that they would buy the 
materials? Xf they were buying Minlpacs for the class-^ 
room» what conponenta do potential consumers indicate 
they would purchase? Xn what quantity? 

2. How might teachers use Hinipacs? For what purpose? 

Bow do they feel they would Incorporate them into lesson 
plans? How comfortable do they think they would feel 
using Hinipacs? 

3. Who are the most likely participants in a school or 
staff development sititatlon? 

4. Do potential users feel that the Resource Manual^ 
facilitates the use of Minlpacs? 

5. What are the apparent strengths of the Hinipacs as 
resources? 



Blscox* Suzanne B** Pamela J. Cutting and Ca^.herlne A. George. 
IntBTpersonal Inftnenae Held Test-^ Itnpact Study and Eajpert Review. 
Portland^ Oregon: Northwest Regional Educational Laboratory^ 1976. 

The Resource Manual will not be available in the published form. 
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6« What an the apparent weaknesses of the Hlnlpacs as 
resources? 

7« How are the Mlnlpacs being used as a resource In a 
residential school with boya of varying ages? How 
are they revised? How well do they work with this 
sample? 

AUDIENCES FOR THE TECHNICAL REPORT 

The Information fron this evaluation will be addressed to four 
audiences: (a) the National Inetltute of Education (NIE) as the funding 
agency of XTCP for monitoring purpoees* (b) potential consumers of SEAL 
(such as school districts » teachers and staff developinent personnel) to 
show how one institution (STC) used SEAL and to present potential 
consunwrs* opinions about REAL^ (c) the Northwest Regional Educational 
laboratory to detenalnE the possible usefulness and marketability of 
REAL^ and (d) the publlahers of SEAL for revisions » publication format 
Ideas and market Information^ 
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REVIEW PROCEDURES 



This section of tha report presents the design of the review^ subjects 
used In the revlev» Instrumentation for the review and the procedures 
used In the review. 

REVIEW DESIGN 

The user revlw was designed to obtain opinions about REAlj from 
potential consumers of the materials. The student versions of REAL 
were supposedly developed for use In high school classes or counseling. » 
High school counselors and teachers » particularly teachers of nontechnical 
courses » were assumed to be the most likely users of SEAL* They were 
also assumed to be the people who would recommend purchase of specific 
materials for their classes. 

Little Information was available concerning potential consumers of 
the adult materials. Xn previous testing of SEAL^ adult workshops were 
offered by NWREL and sponsored by either KWREL^ a «chool» or a state 
board of education. NWREL Is not a potential consumer of the system^ 
however. Since SEAL was designed for use In staff -development activities » 
potential consumers were assumed to be people with declslon^oaking 
authority on staff development acltlvltes. On the basis of this assumption^ 
school principals or school personnel Involved in staff development 
activities were assi|med to be appropriate reviewers. 

The evaluation design required the recruitment of thirty reviewers 
from each of three cities. Reviewers would receive both sets of SEAL 
Hinlpacs (14 Hinlpacs) for their cooperation. Since reviewers were to 
receive no money and since no money was originally budgeted for release 
time for the reviewers > 4*hour reviews were suggested for Saturdays in 
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Septembftr and October. These 4-hour reviews were chosen both to- Increase 
the chances of obtaining reviewers and to allow enough time for reviewers 
to gain some faiolllarlty with the Hlnlpacs. To simplify the process, 
student Mlnlpacs would be reviewed In the morning^ adult Mlnlpacs In the 
afternoon. 

Reviewers » ^ose names were to be randomly selected from apprpprlate 
mailing llats, would receive letters asking them to participate In the 
review and return postcards Indicating their willingness or Inability 
to review REAL^ Telephone follovups of nonrespondents were planned. 

SUBJECTS 

Six groups of subjects from three locations were solicited to 
participate In the field test review of REAL* From each of the three 
sites (Portland* Oregon; Salt Lake City, Utah; and Honolulu, Hawaii) 
principals were asked to review the adult Mlnlpacs or send someone from 
their staff concerned with staff development to examine them. Teachers 
and counselors lu secondary schools were Invited to review the student 
version . 

For each site a listing of principals * secondary teachers and 
counselors In public schools was obtained. Since Honolulu has a number 
of private schools* principals and counselors (a list of teachers was 
not available) from those schools were Included. Tables of random 
numbers were used to select the potential participants. Letters requesting 
persons to participate In the review were sent to 30 principals and 70 
teachers and counselors (combined) at each site. At this time, reviewers 
were offered an honorarium of $30.00 and one complete sec of Mlnlpacs. 
The mailings to Portland and Honolulu Included a letter* an Information 
sheet about REAL and & return postcard Indicating their decision. 
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Because of the short response time allowed Salt lake City respondents, 
they were asked to telephone collect to the system evaluators to Indicate 
whether or not they would participate as reviewers. 

The letter sent out to Portland school personnel originally promised 
both sets of Mlnlpacs for their participation. Due to the lack of 
response, It was decided to offer the participants a $30.00 honorarium 
and one set of Mlnlpacs to help equalize costs. The reviewers were 
notified by telephone of the change, and an additional ten persons from 
each group (teachers, counselors and principals) were selected and asked 
to participate. Copies of the letters and the Information sh^et are 
Included In Appendix B. 

The Portland revlw, held at NWBEL on September 13, 1975, Involved 
eleven reviewers of the student materials and eight reviewers of the 
adult version. The Salt Lake City review, held In a motel conference 
room on Sept^er 27, 1975, Involved fourteen reviewers of the student 
Mlnlpacs and ten reviewers of the adult materials. Twentyfour persons 
examined the student materials, and seven reviewed the adult materials 
In the Honolulu review held October 4, 1975, In a Walkikl hotel conference 
room. 

The background of the reviewers from all three sites. Including 
their present position and familiarity with NHR£L programs. Is presented 
In Table 1. 

KEVXEW AGENDA 

At the beginning of each review session, the evaluators briefly 
described the history and purpose of NWREL and XTCP. Reviewers were 
given pamphlets describing NWREL and Its products and publications. 
After a short Introduction of SEALy the evaluators explained that the 
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Tabls 1 

Background of BEAL Itttvlemrs 





Hufl^ar of Partidpanta 




Adult Varsion 


Studant Varsion 






i#*4g 








Principal 


10 


0 


Vlca-PrlndpaX 


2 


0 




10 


34 


GounMlor 


1 


25 


Othar 


5 


2 


TMch«r*s sublcct Arm 






'SocUX sdwict 


0 


10 


languag* Art« 


1 


7 


Fortlgn Langoag^a 


0 


5 


BusiMss 


0 


3 


iUth/Scl«nc« 


1 


2 


ElMvntATV Gradts 


4 


0 


Othar 


0 


8 


^paclAl Education 


3 


1 


b 

nWREL syatan Pravioualy Attandad 






Curricttlua Oouraa Goals 


3 


0 


Group Pcocoss skills 


2 


0 


naaoarch Otilixing 9zcblt« solving 


1 


0 


Intarparamtl intiuanca 


2 


0 


IntaiparaonAl Oonntnication 


1 


1 


Systaaatic and objactiira Analysis of instruction 


2 


0 


Facilitating Inquiry in tha cXasaroooi 


0 


1 


Syitatt Approach por Education 


0 


1 



^Sona ravlawars fillad dual tolaa» a.t** teachar and counsalor. 

^tipo participants had attaodad thraa KUREL aystana previously; two had attended two; 
other respondents each attended one systaK workshop. 
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»vl«ver8 w«re to skim the Resource Manual and all of the Hlnlpacs. 
They were then to choose for closer exainlnatlon any two Mlnlpacs that 
interested them and to complete the questionnaires. 

Reviewers of both levels of materials (student level from 9:00 a.m. 
to 1:00 p.m. and sdult level from 1:00 p.m. to S:0O p.m.) were given the 
following schedule: IS minutes for introduction of NWREL and the system^ 
45 minutes to skim the Resource Manual » 90 minutes to skim all of the 
Minipscs» 60 minutes to csrefully examine the two they selected » and 30 
minutes to complete the questionnaire. The only portion of the schedule 
that seemed to cause 'problems wss the time allotted for skimming all of 
the Hinipacs. Fourteen reviewers reported that they did not have time 
to skim all the Hinipacs. However, all reviewers Indicated that they 
hsd csrefully studied st least two Hinipacs. 

The Hlnlpacs chosen for close examination are listed in Table 2. 
Since some reviev^rs examined more than two Hinipacs, the entries in 
the table do not add up to twice the number of reviewers. The distribution 
of reviewers examining two or more Hinipacs is presented in Table 3. 

IHSTRUMENTATION 

Two questionnaires were developed for the users* review of REAL: 
one for reviewers of the atudent materials and one for reviewers of the 
adult materisla. The quesionnaires » included in Appendix A» were developed 
by two evaluators in the Improving Teaching Competencies Program (XTCP) 
of the Northwest Regional Educational Laboratory. The REAL review 
questionnaires were patterned after the instruments used in the expert 
review of InterpevBonal Influence ^djiot\i^r ITCP instructional system. The 
instruments were developed by the program evaluators^ then reviewed by 
the director of dissemination and installation services. After further 



Table 2 

Hlnlpacs Chosen fox Close Examination 



HlDlpac Title 


Adult Version 
Reviewers 
N«25 


Student Version 
Reviewers 
K-49 


Being Inftuenoed 


4 


12 


Getting the Meaning of the Message 


5 


5 


Keeping Track of Tim 


6 


7 


Being Helped 


2 


3 


Feeling Dunb 


6 


20 


Being Praised 


8 


7 


Identifying My Needs <S Desires 


4 


9 


Why Learn Anything? 


6. 


5 


Keeping Open to Learning 


2 


7 


Learning on Your Oan 


7 


9 


Letting Someone Teaah You 


2 


6 


Strategies for Learning 


4 


5 


KnoDing Your Om Learning Style 


2 


5 


Learning By Confrontation 


2 


17 
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Table 3 

Number of Reviewers Varsus Number of Hlnlpacs 
Examined In Depth 



14 



Number of Reviewers 


Number of Hlnlpacs Examined 




2 


3 


4 


5 


Adult Version 
Reviewers N*25 


18 


5 


1 


1 


Student Version 
Reviewers ^"49 


39 


4 


3 


3 
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review by ITCP personnel* they were submitted to the Office of Research 
and Evaluation Services for final approval and clearance. 

Both questionnaires asked about the reviewers* positions, their 
familiarity with Instructional systems or materials developed by NWREL 
and their familiarity with Instructional systems comparable to REAL. 
The Instruments also solicited specific comments about the strengths and 
weaknesses of REAL^ the readability of the materials and suggested 
changes. The reviewers were asked to hypothesize a goal (for reviewers 
of the adult materials, a staff development goal; for reviewers of the 
student materials, a class goal) and to Indicate how they might use RSAL 
Hinlpacs to meet It. One question asked reviewers to specify which of 
the Hinlpacs they would recommend their school or district to purchase; 
another marketlng-^dlrected question concerned price as It would affect 
quantity purchased. Two pages, of each questionnaire were to be completed 
by those reviewers who would not recommend the purchase of Hinlpacs for . 
their school or district. Those questions dealth with the specific problems 
the reviewers saw In the Hinlpacs, the changes suggested and siiy situations 
In which they thought REAL would be useful. 
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It£SULTS 



Xn this section of the report only commenta made by two or more 
respondents are presented* Following each comment, la parentheses, Is 
the number of reviewers making that comment* Comments made by only one 
reviewer are not Included In order to eliminate the ptesentatlon of 
Idiosyncratic opinions* 

ItEAl>ABXLXTT, ADULT VERSXON 

Reviewers were asked to comment on the readability of the Mlnlpacs, 
specifically In terms of the vocabulary and the appropriateness of the 
writing style* Of the 25 reviewers of the adult materials, 23 found the 
Hlnipacs "generally easy to read and understand" and 2 reviewers thought 
they were ^'somewhat difficult to read and understand/* The greatest 
number of specific criticisms of the materials referred to the vocabulary 
and jargon In the text (7 reviewers)* Three persons thought It was aimed 
too much at senior high school staffs > two said that the format of the 
Hlnipacs and/or the Resource Manual made reading difficult and three persons 
said there was not enough time allowed during the review to determine 
problems* 

STRENGTHS AND WEAKNESSES, ADULT VERSXON 

The questionnaire used for the review required participants to 
comment on the strengths and weaknesses of REAL in specific areas: 
appropriateness of content for staff, amount of interest to staff, 
material's structure and format of the Hlnipacs (including ease of use) 
snd probable effects on staff* Xn this section, comments made by at 
least two reviewers are listed* The number of reviewers making the comment 
is indicated in parentheses after each comment* 

17 
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Appropriateness of Content for Staff 

Reviewers of the system saw the materials as highly appropriate (5) ; 
good (5) and well-organized (2)* The perceived weaknesses were: the 
materials are too general (2) ; and It takes too long to complete them (2) * 
Aiaount of Interest to Staff 

Strengths In terms of Interest Included: the Mlnlpacs should be of 
high Interest to staff members (9); they have "human Interest" (3)* 
However, reviewers thought that much of the Interest depended on the 
perceived need of the learner i^)^* Some reviewers felt that the Mlnlpacs 
labeled for both students and adults were too general* 
Material's Structure and Format of the Mlnlpacs 

Reviewers rated the structure as good (5) and found the materials 
easy to follow (5)* Conments regarding the weaknesses of the Mlnlpacs* 
structure Included: It would be better If the materials were combined 
Into one volume (S) or If all the group materials were In one volume 
and all the Individual materials were In another (2)* 
Usefulness of the Resource Manual 

Reviewers thought that the manual was useful (8) and very inclusive (2)* 
The perceived weaknesses of the manual Include: it is the ^'poorest part 
of the program** (5); and it is ^'redundant and tedious to read" (4)* 
Probable Effects on Staff 

Comoents regarding the probable effects of the system Included: the 
Mlnlpacs help to develop insights into one*s own and others* feelings (9) 
and to improve communication skills (2) ; as well as to promote staff 
cohesiveness and group growth (2)* However, reviewers saw the materials 
as requiring a high degree of self-motivation; or as not motivating (5)* 
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R£/U}ABXUXY» STUDENT VERSION 

Of the 49 reviewers of the student version of RBAL, 33 found the 
Minlpacs ^'generally easy to read and understand"; 11 thought they ware 
"aomawhat difficult* to read and understand**: and one revlever judged 
them 'Vary difficult to read and understand*" Four ravlawers did not 
respond* Moet of the criticisms were directed at the vocabulary and 
jargon In the text (16 ravlevera)* Other specific difficulties 
encountared vere: students would have to be highly motivated end salf- 
dlsclpllnad (5) ; the materials would be bast for senior high students 
(4); many students who need the activities presented In REAL don^t like 
to read and write (2) and there should be more Illustrations In the 
activity books (2) * 

STREHGTHS AND WEAKKCSS£S» STUDENT VERSION 

Reviewers of the HEAL materials were asked to evaluate the system^ s 
strengths and weaknesses In the following areas: appropriateness of 
content for students^ amount of Interest to students^ material's 
structure and format of the Mlnlpacs (Including ease of use) , usefulness 
of Resource Manual (Including adequacy of Indexing » ease of use) and 
probable effects on students* 
Appropriateness of Content for Students 

Comments regarding REALMS appropriateness Included: the syston la 
realistic and relevant (24); It Increases self-awareness (3)* Weaknesses 
were: It Is too structured (2); REAL la better for older students- 
senior or posthlgh school (2); Set X Is too elementary for high school^ 
and Set XX Is too Intellectual (3) . 
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Amount of Interest to Students 

The reviewers rated the Interest level as follows: very high 
Interest) there are up-to-date and needed materials (17); the materials 
are good for students who are already Interested (5); It has a good 
approach (4); the art work> photographs and graphics are excellent. 
Reviewers saw the main weaknesses of the system (concerning the Interest 
to students) as: the length of time It takes to complete a Minlpac (3); 
some of the titles are too academic and uninteresting (3); the materials 
are too difficult for slover students (3). 
Material's Structure and Format of the Minipacs 

Reviewers made the following comments about the structure and format 
of the Minipacs: the materials are inclusive > veil -planned and the 
instructions are clear (14); Minipacs are easy to use (5) and flexible (3). 
The perceived weaknesaes of the format include: the system is too bulky; 
there are too many packets (13); there are too many "consumables" (7); 
the directions are too complicated or unclear (6). The major change 
suggested was to put all of the Minipacs into one book> rather than 
several packets (9>. 
Usefulness of the Resource Manual 

Reviewers saw the strengths of the Resource Manual as follows: it 
is vell-organlzed> easy to use (7)> and helpful (4). Comments regarding 
the weaknesses of the Resource Manual included: . the manual is time* 
consuming) confusing (7) and redundant (5); it is unnecessary to the 
program (11) . 

Probable Effects on Students 

The majority of the comments dealing with probable effects concerned 
students* personal growth and their increased social and self-awareness (14). 

20 



Other cooments about the strengths of the system Included: the 
effects depend upon each Individual (4); group growth and the cl«38room*8 
atmodphere would Improve (3) ; communication skills should Improve (2) ; 
REAL would generate dlscusalon (2); there should be more openness to 
learning outside the classroom (2). Perceived weaknessee were: the 
syettm may turn off low*»achlevers (2); there need to be more Indepth 
materials and some kind of followup (4). 

PURCHASING 

Reviewers of both levels of materials were esked whether they would 
recommend the purchase of at leaat one Mlnlpac and what characteristics 
of REAL led to such a decision. They were also caked which Mlnlpacs 
they would purchase and with whom they would use them. Finally* they 
were asked to specify how many copies of each Mlnlpac component they 
would recommend for purchase at specified prices. 

Of all the reviewers of both levels of materials, only one reviewer 
(adult materials) would not recommend purchase of at least one of the 
Mlnlpecs . 

Reviewers saw the emphasis upon self ^awareness as the most positive 
characteristic of the system (19 adult, 42 student). Other highly rated 
aspects were: the flexibility of REAL (17 adult, 40 student); the group 
versus individual approach (IS adult, 39 student) and the emphasis upon 
everyday paycho^soclal concepts (16 adult, 38 student). The full tally 
of results Is presented In Table 4. 

The student level Mlnlpac recommended for purchase by the greatest 
number of reviewers was Feeling Dumb (39 reviewers) . Other highly 
recommended Mlnlpacs were: Being Influenced (12 adult, 35 student); 
Lewrning^^^C^m^^ — ~ 
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Table 4 

Batinfs of Positiv« tnd Ntgative Chmr«ct«riatics 
of REAL By R«vi«ii«rs 



Characteristics of REAL 


Adul 


t 


SttM 

N< 


tent 
•49 










na^acxvc 


Flexibility In uae of lEAL sa s 
resource 


17 


0 


40 


2 


The choice between snail froup 
iotarection or individual 
learQlng 




/I 

V 


3S 


1 


TM enpoasis upon psyciio^aociAi 
concepts encountered every day 


16 


1 


30 


u 


The eaiphaais upon seXf-airsrcneaa 


16 


1 


42 


0 


Participant involvMent In self- 
evaluation 


15 


0 


33 


0 


Inclusion of a Beaource Hanual 


10 


2 


22 


4 


Audiotapes 


0 


2 


4 


2 


JaTfon used 


0 


0 


0 


2 


Teacher training needed 


0 


0 


0 


3 


Haterial es realistic and 
relevant 


0 


0 


6 


0 



Se^clB and Deeit^e (20 adult » 28 student)* The least recommended 
coBponent was the Reaource Manual (8 adult » 11 student). Full results 
are presented in Table 5* 

Revlewars ware asked to specify the quantity of aach Minlpac coi^onent 
they would recoonend for purchase at prices designated in the questionnaire* 
Pour possible raaponaes ware supplied: (0) none; (1) one for Instructor 
only; (2) several to be shared and (3) ooe for each student* 
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Many revltwers apparently misunderstood the directions; they wrote in 
numbers like S> 10> 30> 1S0> etc* Their responses are included under 
partial responses in the footnote of Table 6* 



Tsble 5 

Number of Reviewers Recommending Purchase 
of Specific Mlnipacs 





Adult 


Student 


Mlnlpec Title k 


R-25 


1I-49 


Being Influenced 


12 


35 


Getting the Meaning of the Message 


10 


22 


Keeping Track of Tim 


10 


21 


Being Helped 


10 


16 


Feeling Dumb 


15 


39 


Being Praised 


10 


23 


Identifying My Seeds and Desires 


20 


28 


fffty Learn Anything? 


11 


29 


Keeping Open to Learning 


10 


28 


Learning on Sour Om 


10 


25 


Letting Someone Teach You 


9 


23 


Strategies for Learning 


10 


24 


Knotiting Your Cm Learning Style 


16 


25 


Learning by Confrcntatiane 


12 


33 


Resource Manual 


8 


11 



Reviewers^ responses are presented in Table 6. In general* reviewers 
indicated that they would purchase larger quantities of Minipac components 
et the lower price ranges. For the Directions Booklet » Key Ideas Booklet 
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and complete Mlalpacs» reviewers tended to recommend purchase of only one 
copy for the Instructor or not recommend purchase at the higher price 
ranges. At lover price ranges, reviewers recommended purchase of one 
copy per student or several shared copies. For the Search and Self- 
Assessment Booklets, fewer reviewers saw the purchase of only one 
booklet or no booklets as satisfactory. The purchase of one or several 
audiotapes was recommended by most reviewers at any price range. At 
the most expensive range, the purchase of only one tape or no purchase 
were usually reconanended. 

SUGGESTED REAL PARTXCXPANTS 

Reviewers of both levels of materials were asked to specify the 
group with whom they would use SEAL. The majority of those examining 
the adult level materials Indicated that they would use Minlpacs with 
all staff members (16 reviewers). Other groups specified were: 
counselors (5); teachers (5); resource teachers (2) and parents (2). 

Of the 49 persons examining the student level materials, 34 indicated 
that they would use SEAL with all students. Other groups specified were: 
students with emotional problems (8) ; underachlevers (4) ; high achievers 
(3) and entering freshmen (3). 

OOAtS 

The questionnaires for both sets of reviewers posed possible goals 
for the use of REAL la classroom/ counseling situations (for the student 
materials) or staff development goals (for the adult materials). Reviewers 
were asked to indicate which of the goals they thought were applicable 
to their future use of the system. For both levels, creating self-* 
awareness was the most commonly checked goal (adult 19, student 32). 
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Ttbl« 6 

thnlwr of Revltmra ittco Btn dlns Furchast of 
$p«clfl«d Quaneieisi of Mliiiptc CompoMiies te $p«clfltd Prlc«« 







Quaneiey of Covpontne 








Ont far eht 


S«v«rftl 






L«v«l of 




interuceor 


To U 


Ont for Cteh 




HftCtriAls 


Nont 


Only 


Shartd 


Ptreiclpine 












$ .50 - $1.00 


Adule 


0 


3 


1 


5 




Seudsnt 


1 


5 




10 


$1.00 - $1.75 


Adule 


0 


3 


5 


1 




Seudme 


1 


S 




2 


$1.75 - $2.50 


Adule 


0 




5 


0 




Seudtne 


3 


11 




1 


$2.50 - $3,25 


Adule 


1 


6 


2 , 


1 




Seudme 


5 


13 


0 


1 


tSZ IDEAS BOOKLET 










$ .50 - $1.00 


Adule 


0 


2 


1 


6 




Seudtne 


0 


3 


10 


11 


$1.00 - $1.75 


Adule 


0 


2 


3 






Seud«iie 


0 






6 


$1.75 - $2.50 


Adule 


1 


3 


4 


1 




Seudme 


3 


7 


7 


2 . 


$2.50 - $3.25 


Adule 


1 


5 


2 


1 




Seudtne 




11 


1 


2 


ssAius Booiicr 












$ .75 - $1.25 


Adule 


0 


2 


2 


5 




Seudtne 


1 


1 


3 


14 


$1.25 - $2.00 


Adule 


^ 0 


2 


3 


4 




Seudtne 


1 


2 


11 


5 


$2.00 - $2.75 


Adule 


0 




3 


2 




Seudtne 


2 


5 


7 


5 


$2.75 - $3.75 


Adult 


0 


5 


2 


2 




Seudtne 


3 


10 


5 


1 



W rtspoMt^ Adult 4, Seudtne 3* ptrtlctl rttpanst, Adule 12, Seudtne 27. 
Adule mnetrltlf' rtvltmrt H*25; Seudtne aAetritls' rtvltwtrs tH49. 
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Ttble 6, coneintied 







Quaneiey of Cosponene 








One for Che 


Several 






L«v«l of 




Iiwcruc cor 


To Be 


One for Bach 


Price Sang* 


Hteeritlt 


None 


Onlv 


Shered 


Pareicipane 


SEIF-ASSESSHENT SOOKLET 










$ .50 - $1.00 


Aduie 


0 


2 


1 


6 




Seud«ne 


0 


1 




14 


$1.00 - $1.75 


Adulc 


0 


2 


2 


S 




Student 


0 


3 


10 


6 


$1.75 - $2.50 


Aduie 


0 


3 




2 




Seud«nt 


2 


5 


8 


4 


$2.50 - $3.25 


Aduie 


1 






t 
z 




ocuacuc 




6 


5 


3 


AUDIO TAPES 












$1.00 - $2.00 


Aduie 


0 




3 


z 




seudftfie 


0 




11 


4 


$2.00 - $3.00 


Aduie 


0 




3 


2 




Seudtne 


1 


6 


11 


1 


$3.00 - $4.00 


Aduie 


1 


5 


2 


1 




Seud«ne 


5 


9 


4 


1 


$4.00 - $5.00 


Aduie 


1 


5 


z 


1 
1 




Seud«ne 


6 


9 


3 


1 


$5.00 - $6.00 


Aduie 




/. 




1 
1 




Seud«iie 


8 


9 


1 


1 


OCHPLEtE MIKIPACS 










$3,00 - $4,50 


Aduie 


0 


3 


2 


4 




Seudine 


0 


2 


9 


8 


$4.50 - $6.00 


Aduie 


0 




4 


1 




Seud«ne 


0 


6 


10 


3 


$6.00 - $7,50 


Aduie 


0 


5 


4 


0 




Seudene 


3 


8 


5 


3 


$7.50 - $9.00 


Aduie 


0 


7 


2 


0 




Seudene 


7 


a 


3 


1 
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No additional goals v«re propoaad by at least tvo of tha student 
v«rsian*s reviewers* Three adult version reviewers thought that REAL 
could help promote staff unity« Full results for ther adult version are 
presented in Table 7* Results for the student version are presented 
in Table 8« 



Table 7 



Goals for itSAL: Ad at Version 



Goal 


Number of 
Reviewers 
Responding 
N-25 


Helping staff work in groups 


8 


Creating self -awareness among staff 


19 


Helping staff examine the way they 
act with others 


14 


Creating staff unity 


3 


Table 8 




Goals for SEAL: Student Version 


Goal 


Nunibtr of 
Reviewers 
Responding 
M-49 


Helping atudents work in groups 


10 


Creating self -awareness amoung students 


32 


Helping students examine the way they 
act with others 


21 


Helping students with special problems 


13 


Helping students take responsiblity for 
their own learning 


21 


Motivating students 


15 


Teaching students to discuss and 
analyze their own experiences 


14 
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Participants were asked whether there was a specific goal for their 
class (student version) or a staff development goal (adult version) that 
SEAL iiilght help to meet* Of the 25 reviewers of the adult materials > 3 
Indicated that they did not have a goal, and 2 did not answer the question* 
The most coim&only expressed tfoal concerned creating self -awareness among 
staff members (6)* A list of the goals expressed by at least two 
respondents Is In Table 9* 



Table 9 

Specific Goals for Staff Development Using REAL 



Goal 


Number of 
Reviewers 
Responding 
N«25 






Creating self-awareness 


6 


Helping staff examine how they work 
with others 


4 


Improving communications skills 


2 


Helping professional growth 


2 



Many of the respondents did not complete the section of the 
questionnaire asking them to briefly outline the ways in which REAL 
could help them meet the goal they specified* Those who did et least 
partially answer the question indlceted that they would use group 
discussion (10 respondents) and individual use (4) to incorporate 
ii£4X into their staff development programs* Four persons would use all 
of the Minlpacs, two would use Set X and two would uaa only Set II* 

Of the 49 participants reviewing the student version, 5 said they 
did not have e goal that REAL might help them to meet; 4 did not answer 
the question* As with the adult materlels, the greetest number of 
28 



xesponses conc«rned cxeatlag sel£-aw8x«a«S8 eunoag usexa (23) . Othex 
goala expxftssftd by two ox moxe paxtlclpaats axa listed In Table 10. 



Tabla 10 

Specific Goals fox Clsasss Using liBAL 



Goal 


Nuiiibtr of 
Rifvlwers 
Eespondlng 

N^9 


Cr«atla8 stlf^amrMtss 


23 


Htlplng studtnts tsfc« rssponslblllty 
for thtlr own Issrnlng 


3 


lUlping studmts cope with dally 
probl«ns 


2 


laproving coanmicatlons ikllls 


2 



Group discussion was ths iikost ofttn rtconnwiultd mMns of Incorporstlng 
ISAL Into dsssroom work (20) . Ssvsn of tht raspondsnts vould advocst« 
Indlvldusl work with tht Hlnlpscs. Twslvt rsvlswsrs would uss sll of 
tht Hlnlpscs to Mst thslr goals. 

SYSTEMS COMPARABLE TO REAL 

Barltvara of both atudtnt and adult vtralona vara aaktd to aupply 
Inforaatlon about inatructlonal oattrlala convartbla to SEAL. Tht 
<lu«atlonnairta rtqulrtd tht following data: naM of tha ayatta> advantagta 
of REAL ovar tht other ayattn and advantagta of the othtr ayattm ovtr 
HEAL. Only 15 rtvltwera auggaattd othtr ayatema. Tht major atrtngtha 
of HEAL wtrt tha varltty of actlvltaa aa wall aa tht group and Individual 
approach. The advantagaa of other ayattma Included comnanta about coat 
and coMpactntaa of packaging. A complete Hat of the altamatlvea 
auggaatad la praaanted In App«ndlx C. 
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SELECTEX) REVIEWER COMhEHTS 



In this section some of tha comments made by the reviewers (or 

excerpts from categories of comments) are presented. The comments 

generally relate to areas not covered by the questionnaire or sum up the 

comments expressed In answer to questions. 

**The materials presume certain verbal and reading 
comprehension levels which In my estimation are higher 
then that of the average student. In those sltitatlons 
where students would be working on their own> I think 
that It would require quite a bit of concentratlcm and 
a good deal of motivation on the pert of the student 
to follow through with the exercises. Except In the 
case of a student with well-established self-dlsclpllne » 
the group approach would probably be most effective. 

^*The reading level should be down*graded so that It can 
be used by retarded students. . .all areas are good for 
the retarded. 

"I am really excited about the whole series. Terrific! 

lot of tha Hinlpaca are appropriate for the slow 
and alienated student, but I would sareclally use It 
In my phlloaophy and thinking clsaaas where we explore 
aalf-ldentlty sad valuaa and dadaion making. 

"It lacka a material flow of taaka^too much shuffling 
between booklata. 

"I Ilka the aaparata Minlpaca. I would not put them 
together In one booklet»for counseling they are 
batter packed to uaa individually... 

"Information la very Interaatlng for aalf-lmprovement, 
but I think few people would put tha time required In. 

^^SBAL could [be] a threatening tool to ataff members 
who are Inaacura with their own paraonal being. 

"[The Minlpacs] need to be modified for elementary 
[achool] faculty." 
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SFAULDINC YOUTH CENTER STUDY 



In April 1975, NWSEL contr«ct6d with th« Sp«uldlng Youth Centar (SYC) 
of Tllton, New Htinpshlrt, a rasldentlal prlvata treatmaQt center for boys 
between the eges of 8 end 14 for use of RBAL Sat I Minlpacs. The complete ^ 
9*page report describing the use of RBAL at SYC Is Included In Appendix D. 
A sunnary of the report la praaanted below. 

Speuldlng Youth Center agreed to use SBAL In soclel akllla clesaes 
preeented in the raeldentlel cottagea at the canter. In soclel skills 
dessaa, usually en hour one evening a week, behavioral prlnclplea ere 
used to teach boys social skills such as decision making, cooking and 
compromise, which they leter prectlce in structured situstioos. Minlpacs 
were informally preeented to nine cottege teachers. A cash bonus 
incentive was offered to teechers using Minlpacs. Six of the nine 
teachere chose to use Mlnlpecs in their social skills classes. These 
teechera initially reviewed saverel Minlpacs, then chose particular 
Minipaca to use in e soclel ekills daas. They used the Minipeca only 
as e beela for the deea and could modify them as necessary. Boys* 
behevloura in the dees using Minlpacs and their followup work on 
Minipaca were obeerved end reported. 

While sll teechere egreed to use one Mlnlpec, two of the aix teechers 
used more than one Minipec. The Minipece used in the daaeea were: 
Being Praised (3 teachera); Feeling Dtonb (2 teachere); Being InftuBtioed 
(2 teechere; Identifying My Ifeede and Deeiree (1 teacher) and Being 
Helped (1 teacher). Teechers* retlonale for the eelectlon of Minlpacs, 
preeented in the full report, vme baaed upon their anelyala of the boys* 
psychologlcel needs end/or the Minipaca* content which would help alleviate 
problems in working with the boys. 



Being Praised was chosed In an effort to Increase praise glvei^ \y 
the boys to each other. Being Inftuenoed was also considered relevant* 
particularly In terms of the boys* reactions to peer Influence. Two 
teachers selected Feeling Dumb because they perceived many boys as 
having poor self*lmages and needing to learn when they should and should 
not feel dumb. Being Helped was chosen to facilitate helping relationships 
between the boys and the staff. Identifying My Neede and Desires was 
selected by one teacher to encourage boys to think about their needs and 
desires In planning for their futures. 

Teachers generally used selected parts of the Hlnlpacs. For 
example > Key Xdeas Booklets were used seven of the eight times that 
Minlpacs were taught. Key Xdeas Sheets > Search Booklets > and audiotapes 
ware used with the second most fre<iuency. Five of the eight teachers 
used the games. Directions for Group Use were not used. 

Teachers* reactions to the Minlpacs were somewhat mixed. Kost 

teachers felt the classes had gone very well and that both they and the 

students had learned from the lessons. Other teachers were not as happy 

with the claas> noting problems In their presentation of the material 

of the task. Host teachers felt the Minlpac Ideas were worthwhile and 

relevant. At the same tlme> they were overwhelmed by the number of 

suggested ectlvltee and needed more time than usual to develop lessons 

based on the Minlpecs. Samples of the teachers* comments are presented 

below; complete comMnts ere Included In Appendix D. 

**My reectlon to the Minlpecs Is a very mixed one. 
X wes pleesed with the final results of my classes 
but the amount of time needed to prepare the classes 
from the Minlpecs was excessive. Xn both sets of 
Minlpecs » Feeling Dwrih and Nsede and Desires ^ my 
preparation time ran roughly double to what It 
normally does* 
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**I found tha topica explor«d to b« v«ry Mlevaat to 
thit population. I wa« initially haaitant to try 
auch aanaltiva topics with thla group » but I am vary 
glad that I did. If I waa planning classes for a 
new group of boya> I would make use of these topics 
again. 

"Bstn^ HelpMt: In thia package* I used the Hlnipac 
tape. The ontaic wee great; enjoyed by ell the boys. 
The Kay. Ideea Shaete end Boolitlete were used* These 
proved to be quite eucceaaful* aapaclelly the 
illustretions end certoons which elone provided 
enough etloull for leemlng end having fun* More 
of thle» pleeee. 

**If the MlQipec had been limited eolely to the Key 
Ideaa Book end maybe one Actlvltiee Book dealgning 
a curriculum baaed on lt» it would not heve eppeered 
to be euch en eweeome teak. 

**B0ing Influenced: I felt thet thla ms e needed 
subject for the boye. But I could not find concrete 
deaonetretlons suggested by the Hlnlpaca. One of 
the weekneseee of my first leeeon was that it waa 
totally dlecusalon* no role pleya or games. The 
boye were not too enthusieetlc ebout the topic. 
In between the firet and aecond leeeone* I did some 
indivlduel work with e few boys. They eech filled 
out e diagram similar to the one used in the firet 
deea* We then individually diacusaed eech influence 
end ettempted to differentiate between strong end 
weak influences end good and bed influencee. I was 
very pleeeed with the boys* reeulte. The eecond cleas 
was alto more pleeeing. The boye were enthusieetlc 
ebout filling out the Being Jnfluenoed diagrams* 
even though they often complained in order to avoid 
doing written work. I did not heer any complaints 
about filling out the diagrems* The boys had 
difficulty eeylng what influence meene» but their 
answere on the diegrama etteeted to, the fAct that 
they underetood the concept. The flniehed diagrams 
provided ineight into the boys and their ecelng eech 
othere* influence on them. 

^^Being Praised: In sum» my curriculum wes much too 
broed. A single Hlnipac has material enough for 
five to ten lessons when taught to a young population 
as was the case here* A good indicator of the 
functionel level of the boys involved is that none 
of them knew what the word upraise* meant* although 
they understood it once I defined it.** 
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Observations of tht boys In a limited number of classes Indicated 



a high degree of ontask behavior. Observations of boys outside of class 

did not show lasting observable effects of the class. Several teachers 

reported anecdotal Information* however, which reflected the Hlnlpac 

topics. Several teachers also reported personal feelings that the 

classes had affected some boys. Samples of the teachers* comments are 

presented below. 

**Although the class was weak on showing If there was 
any change, subjectively the Instructor feels closer 
to *where the kids are at* and In their own way, theyWe 
become closer to him. 

"The boys* participation In the Minlpac classes 
revealed some very Interesting Information about 
th^aselves. I felt that I had gained more knowledge 
about these boys In the four Minlpac classes than In 
any other four aodal skills classes. 

**The overall effect of the curriculum was a temporary 
Increase In the rate of praise statements* This 
Is Subjective data, as no baseline data was taken. 
However, In my 16 months of work with this population, 
I can remember few. If any, instances of praising peers. 
Peer provocations, as recorded dally » showed no decrease 
during or after ttte two currlculums. Even If a decrease 

^ — w as-e v ld en t,^- h o w ever-r-^tfrts- woul ^-not-b e - re liabl e d a ta " 

as there are many variables affecting this measure. 
The temporary Increase was most likely due to the 
curriculum. There was an initial enthusiasm for 
earning the chosen relnforcer which faded over time, 
(probably as the learner realized the impossibility of 
their task). But the data does show that praising did 
occur during the week. 

**ffss^ and Desires: It is too early to tell if there 
is any long lasting effect from Needs cfftd Desires 
classes, but I have seen some very positive short 
term effects from the class. I worked individually 
with three boys. I foimd that given the vocabulary 
they learned in class, we were better able to 
communicate about some very important subjects. 
Hearing their answers in class has given me a great 
deal of knowledge about them. Identifying their needs 
and desires appears < to have beneficial effect on at 
least one of these boys. This boy had been very 
ambivalent about certain needs and desires and judging 
from his behavior in a few discussions, he seems to 
have a clearer idea of what he wants. 



''Being Trtftueno^d: On occasion^ I found it uatful to 
r«f»r back to tha claaa when I was working with on* of 
tha boya. Tha boy haa a reputation for not coming back 
to Spaulding Touth Cantar after he vlsita home. Hi* 
peer* have been reinforcing him for this. This boy had 
to go hoM for a few days. Before he had the opportunity 
to tell his friends he wes leaving » I proposed the idea 
of keeping it a aacrct ao they wouldn't influence hit 
behavior. He agreed to the experieneott and returned on 
tine two daya later. There were »any factors as to why 
he returned on tine* but the influanca axperiment may 
have helped." ' 
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RECOMHENDAIIOMS 

RECCNKEMDAIIOKS 10 POTENTIAL COMSUMEBS 

BM«d upon tht vmvimr of REAL^ tdult and student Mlnlptct eppttr 
to b% pronltlng rttourctt for ruchlng goalt «uch scl£-«varttncsa» 
•bility to work In groups ud hslping Individuals to examlna ths way 
thay act with othara* Tha Mat promialng Mlnlpaca ara Feeling Dmb, 
Being Inflmnoed, Idmtifying My Needs and Deeiree and Learning By 
Canfrmtaticne. 

In ganaral^ REAL ia auitabla for uaa with all high achool atudanta 
aa vail aa with elanantary ai^ high school ataff . Tha Raaourca Manual 

ahould ba axamlnad» aa ica utafulnaaa waa quaationad by aom raviewara. 

* 

In conaidaring atrangtha and waaknaaaaa of tha adult Hlnipacs^ 
readability ia ganarally good» although thara wy ba aooa problaa with 
Jargon* fonat or a poaaibla focua upon high achool ataff. The natariala 
are ganrally appropriate and vail organized. As reeourcee* however » 
they nay require aupplementel ectivltee to make than epedfic^ or selection 
of eevetel ectivltiea beceuse of tlM linitationa My he neceeemry. 
The Mlnlpaca ahould ba intereetlng to eteff elthough intereet end 
motivation vlll vary beaed upon the perceived need of the leemer. The 
etructure ie felrly good and aaay to follov. Pertldpation In JSEAL nay 
reault In Inalghta Into one*e om and othere* feellnge and ljq»rove 
coMunlcetlon or cohaalvenaaa. RSAL ia aeen ea pertinent to ell ataff 
as wall ee counaalora* taachere» reaource teachara and peranta. 

In conaidaring atrengthe and weaknaeeee of the etudent varalon^ the 
vocabulary and Jergon aay cause eoioa problems. The materials may be 
beet for highly motivated and aelf-dieciplined senior high atudenta. 
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Uae of REAL with high achievers, entering freshmen, emotionally troubled 

atudents and underachlevers could alao be considered. Use of REAL with 

undarachlevers or problem students appears questionable, however, without 

a great deal of revision. 

The use of REAL at the Spauldlng Youth Center Indicates that REAL 

Is adaptable for specific populations, such as emotionally disturbed boys, 

^e . 

it the main concepts are considered Valuable. Revisions In such 
Instances would be extensive, however. The materials are current and 
pertinent and represent a good approach to the topic, especially for 
studenta already Interested in the topics. Set I and Set II should be 
examined closely for appropriateness since they differ considerably in 
the Intellectual approach to the topic. The structure of the material 
Is good; however, there may be problems In the bulkiness of the system. 
Student pertlclpatlon In REAL Is likely to result in Increased personal 
growth and self-awereness m well as Increased social awareness. 

RECOMMENDATIONS TO THE PUBLISHERS 

Marketing efforts for REAL should be In the arees of self development 
and group communication skills. REAL should be marketed as a resource 
for uae with adults and primarily motivated, self -^dlrec ted and mature 
students* While REAL could be marketed for use with underachlevers and 
problem students, this Is not recommended beceuse of the amount of 
redesigning necessary for work with these types of students* (This Is 
also supported by Interim test data; Hlscox & Rothllnd, 1975, 1976.) 

Packaging of Mlnlpecs should receive careful consideration. 
Minlpacs should be sold individually rather then as complete seta. 
Audlotepes, If evallable for purchase, ahould be sold separately, since 
only a couple would be purchased for any class. They could also be 

3« 



ellMlnated^ since relatively few would be purchaaed. The cost of 
Hlnlpacs will affect what la purchaaed and prices should be as low aa 
poaalble. Xt might be poaslble to reduce coata through reducing the 
amount of conaumable material and packaging together all bookleta In 
the aame Hlnlpac. 

Xt appeara that the student veralon of REAL should receive conalderable 
editing before final production. Jargon and difficult vocabulary should 
be alo^llfled and directions should be clarified. The adult materials 
need conalderable leaa editing. Pictures and cartoons In the Hlnlpacs 
should be k«Pt and added to If possible. 

SECOMKENDATXON TO THE NORTHWEST REGXOMAL EDUCATXONAL LABORATORY 

Xt appears that there Is a market for SEAL and that reviewers 
consider It a worthwhile reaource. The material should be released for 
publication^ with the possible provision that the student materials 
receive further text editing either by NWREL or by the publisher. 
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jA^pendix A: 

REM. REVIEW QVBSTIOmiMItES 



REVIEW OF REAL: ADULT VERSION 



Please b««e your aoswere .to all of the following questions upon the use of 
REAL for school persotmel stafC development. 

1. What la your poaltlon? 
Principal 

Vice Principal 

Counselor 

Teacher - Subject area: 

Currlculuft Specialist - Area: 

Other - Please apedfy: 

2* Are you faBillar with any of the Inetructlonal prograos or matariala 
developed by the Mortfaifest Reglonsl Edutetlonal Laboratory? 

Yes 

No 

I don*t know 

If yee* which one(e)T 



3« Did you eUa through ell of the Mlnlpacat 
Ho 

b« Which ones did you exsmlns closely? 
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Do you know of other materials which ere slnller to SEAL? 
!to 

Yee -Ntte of system: 

s. What edveoteges does REAL offer over the other eyetca? 



b* What advantages doee the other eyeten offer over REAL? 



Do you feel that teachere and bulldlog etaff would find the naterlale 
eeay to read and underetand (l.a. » are the vocebulary and writing 
etyle appropriate)? 

Y#a, generally eaey to reed and underetand 

SoMwhat difficult to read and underetand 

No^ very difficult to read and underetand 

Pleaee ejcplaln any dlfflcultlee you perceive. (If poeelble. Identify 
epeclflc worde or actlvltlee which preeent dlfflcultlee*) 



In your opinion vtut art tht ttrtngths and vtalmttttt of tht Mlnlptct 
In ttru of tht catttorltt llattd? Pltast dlrtct your coMMntt to 
tht tm Minlpact you txtMlned dottly* 



Approprlatmttt 
of contttit for 
^taff 



Awnint of 
Atnt«rttt to 
%tt££ 



^Kittrlal^t ttruc^ 
turt and f onat 
of tht Htnlpact 
(Ificlttdlnt tast 
of uat) 



Uttfttlntat of 
rttourct unuaX 
(Inclttdint 
adaqiucy of 
Atndtxintt Mtt 
of um) 



Ftobablt 
tfftcta on 
ibtaff 



^Othtr 



Strtnatht 



Wtaknttttt 



SutMtttd Chanaet 



r o 
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1* m* tfould you rtcoMtnd that your school purchaw tt lettt onft of th« 
Ninlpmct for tttff d«velopmiit purpowt? 

Y«i 

Nb 

Xndlcttt char •cttrtltt let of UAL vhlch l«d to your dtdilon coq- 
c«mlti$ • rtcoiwdatlott. 8o«* pOMlblt char tcttrltt let art 
llatad balov* Wrlta In othara you faal ara tsportant* Than put 
a 'V* in tha blank bafora «ny poaltlira faaturaa affactine your 
racoMandatlon Md • ***** btfora any ut*^lv« faaturaa* Laava 
tha apaca bafora wy Irralavwt charactarlatlca blank* 

rimlblllty In uaa of UUU. aa • ratourca 

Tha cholca batnaan Mall (roup Intaractlon or Individual 

laarnlnt 

Tha «BpbMla upon paycho-^ioclal concapta ancountarad 

avaryday 

Tha Mphaala upon aalf-amranaaa 

, Participant Involvavant In aalf-avaluatlon 
Xnclualon of a ratourca aanual 
Othar Important tttrlbutat 
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If your www to Qutttlon 7 w no, plw skip to Quettlon 13. 
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If you %iould recQHimd tltA purchtst of Mlnlptci» %ihlch onti %iould you 
iuggtit? 

, B«lag Influenced 

Gftttlnt thm ttoanlng of th« IteiiaM 
KMplnt Track of TiM 

Being Helped 

Peeling Jhmh 

Being Preleed 

Identifying Hf Neede and Deilree 
Why Learn Anything? 

Keeping Open to Learning 

Learning on Tour Own 
Letting SMeone Xaech You 

Streteglei for Leemlng 

Knovtng Tour Ovn Learning Style 
, Leemlng by Confrontetlone 

Reeource Manual 

In ^ staff developMnt situation^ %ilth vhon wuld you uie Mlnlpace? 
(For e9unple» ell staff » counselors^ librarians^ hou ec«teechers» 
etcj 
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10* For whtt |oa1(«) would you bt nott llksly to utt REAL? (Check no 
ttort than two*) 

Helping staff wtt In groups 

Craatlng aalf^awarantaa aaong staff 

Balplng staff axaalns tha vay thsy act vlth others 

Othsrs * plsasa spaclfyt 



11* Is thsrs a specific staff dsvslopMnt goal Which UAL might help to 
Mst? (Statements In qusstlon 10 may hslp you think of a goal*) 



Tss 



No 



a* If Ysa> writs the goal bslow*. 



b* firlsfly outllns how you might Intsgrats SEAL Into your staff 
development program to meet the goal epeclfled In 11 *a* (Uee 
the back of the page If neceeearyO 



Actlvltlee/ 
materlale ueed 

(both UAL and 
other actlvl- 
tlee) 



Amount 
of time 
allowed 
for 

ectlvlty 



Probable 
eeituence 

of 

actlvltlee 



Method of using (groupe» 
Indlviduale » 
dle€uMlone» etc.) 
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For thm following qummtionm plusm indicitt« tha numbmr of Mch Htnipac 
coaponmntm you vould rtcooMod purchmming* Asmuu thmt you mr« buying 
cosponmntm only frov Minipto you hmv« rmcoMMnd«d purchmming* 

0 « nont 

1 • onm for thm trminmr(fl) 

2 - m«vmrml to bm mhmrmd by mtmff pmrticipmntm 

3 • mnough for mmch participant to hmv« him/h«r own 

12* Row aany Diraytloni Bookltta vould you r«coiDBmnd purchaming if 
th«y co«t: (Put m numbtr b«for« Mch blankO 

$.50 - $1*00 $1*75 - $2.50 * 

$1.00 - $1.75 $2.50 - $3.25 

b. How mmy Kay Id— tooklftf (plut tmy Idmmt Shut) would you 
rmcowMfwl purchiting if th«y cott: 

$.50 - $1.00 ^ $1.75 - $2.50 

$1.00 - $1.75 $2.50 - $3.25 



c. How Mny Swrch >ookltt(t) would you Ttconaviul' purchaming if 
thty comt: 

$.75 - $1.25 $2.00 - $2.75 

$1.25 - $2.00 $2.75 - $3.75 

d. Row uny 8tlf*A»MMntnt Booklmf would you r«cointnd purchmting 
if th«y comt: 

$.50 - $1.00 $1.75 - $2.50 

$1.00 - $1.75 $2.30 - $3.25 

«. How May Audld*T^p— would you rtcoH«nd purchaming if tbay comt: 

$1.00 - $2.00 $3.00 - $4.00 

$2.00 * $3.00 $4.00 * $5.00 

$5.00 - $6.00 

f . How many coaplmtm Minipacm would you rcconend purchaalng if chey 
comt: 

$3.00 - $4.50 $6.00 - $7.50 

$4.50 - $6.00 $7.50 - $9.00 



Bad of qumationnmire. Thank you. 
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If you would not recooKend purchasing Minipacs» please answer the 
following quastions. 



13. How would REAL have to be chained before you would recommend it? 
Please ba specific » referring to ths Mjnipacs you examined when 
possibls or appropriate. 



Ptobl« 



tsstsd Changed 
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Are th«re ftltuationa for which REAL vould be useful? Describe the 
situetions end how Mlnipacs might be used in them« 







Potential ways 


Situation 


Applicability of Minipacs 


of using Mlnipacs 









51 



53 



REVIEW OF REAL: STUDENT VERSION 

Please base your answers to all of the following questions upon the use 
of REAL with high school students* 

L* What is your position? 

Principal 

Vice Principal 

Counselor 

Teacher - Subject area: 

Curriculum Specialist - Area: 

Other " Please specify* 

2* Are you familiar with any of the instructional programs or materials 
developed by the Northwest Regional Educational Laboratory? 

Yas 

No 

I dott*t know 

If yes> which one(s)? 



3* Did you skim through all of the Hlnlpacs? 

a. Yas 

No 

b. Which ones did you examine closely? 
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Do you know of othtr natftriali vhich are limilar to REAL? 
Ho 

Yt* -NCM of lyetra: 

1. What adV4nt4$ei doei REAL offer over the other eyetcm? 



b. Whet edventasea doee the other eyatm offer over REAL? 



Do you fetl that studente would find the neteriela eeey to read and 
understand (i.e., era the vocetmlery end tnrltlng style appropriate)? 

Yea, geikerelly eeay to reed end underetend 

SoMwhat difficult to reed end underatand 

, Mo, very difficult to read end underatand 

Pleeae expleln eny difficulties you perceive, (if poaelble, identify 
specific words or ectlvitles which preeent difficultlee.) 
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6. In your opinion iriue ebo oeronitho tod iftaluteoooo of eht Hiniptco 
in cotw of eho cteoforiM lioetd? rioMo dir«ce your co«Mneo eo 
tYm two HitkipACo you wmitMd cloMly. 



Strnathg 



Ap^ropriaemtco 
of cMCvde for 
•eudneo 



ttMkaoo— a 



S<ttwttd Chtmoo 



Amme of 
tneorMC to 
•eudueo 



HftCorialU oenit- 
turo and f omae 
of eba Htnipaco 

(lAClttdlAS MM 



UnfttlMoa of 
rosonrco Mnual 
(taclodlAS 
tdtt^juaey of 
iodixint, oaoo 
of um) 



'?robotlo 
•ffocto on 
•Cudatito 



oehor 
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7. a. Ubuld you recooMnd that your school purchase at least one of the 
Minipaca for uae with tftudenta? 

Yaa 

No^ 

b. Indicate charactartiatica of REAL which led to your deciaion con- 
carniDg a rtcoMcndation. SoMe poaaible characteristics are 
listed below. Write in others you feel are Important. Then put 
a in the blank before any positive features sffecting your 
rwoMendetion and a before any negative featuree. Leave 
the space before any irrelevant characteristics blank. 

FlMibility in uae of REAL aa a resource 

^ The choice between small group interaction or individual 
learning 

The evphaals upon psychosocial concepts encountered 

everyday 

The enphasls upon self-awarenesa 

^^^^^ Participant involvement In self^evaluation 

Inclusion of a resource manual 
Other Imporcant attributee 



If your answer to Question 7 was no» please skip to Question 13^ 
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If you would recoBocnd thm purchaM of Minlpac«> which ohm would you 
•uggttt? 

Being InfluAiiccd 

Getting the Meaning of the Heeeege 

Keeping Track of Time 

fielng Helped 
Peeling Dmb 
Being Preleed 

Identifying My Meeds and Deelrea 
Why Learn Anything? 

Keeping Open to Learning 

Learning on Your Own 
Letting SoMone Teach You 
Strateglee for Learning 
Knowing Tour Own Learning Style 
Learning by Confrontations 
Reeource Manual 

In a clasaroom or counseling e^ltuatlon> with whom would you use 
Mlnlpaca? (For example) all students* high achievers* minority 
students* students with eoiotlonal problcow* etc«) 
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10* For what go^Ks) would you b« ttO«C likely Co use REAL? (Check no 
ttore then two*) 

Helping scudence work In groupe 

Greeting self-ewireneee enong ecudencs 

Helping scudence exemlne Che wey chey ecc wlch ochere 

Helping ecudence wlch epeclel problene 

Helping ecudence ceke reeponelblllcy for chelr own leernlng 

Hbclveclng scudence 

Teaching scudsncs Co dlecuee end eoelyze chelr own experiences 

Ocher - pleeee epeclfy: 



11. le chert a epeclflc goel for your clase which REAL mlghc help Co meec? 
(Scecenencs In queeclon 10 My help you chink of a goelO 



Yes 



No 



e« If yes, wrlce che goal below* 



b* Briefly oucllne how you mlghc Incegrece REAL Inco your classroom 
Co meec che goel specllfled In ll*e* 



Acclvicles/ 
aacerlale ueed 
(boch REAL end 
ocher ecclvl- 
clee) 
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Amount 
of cine 
allowed 

for 

acclvlcv 



Probable 
ee<|u«nce 

of 

ecclvlcles 
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Mechod of using (groups , 
Indlvlduale , homework, 
dlecusslone^ ecc.) 
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For thi followlag queitlOQi plcaii lndic4tt the nuaber of uch Hlnlp4c 
cmipottcnti you would rtcoMtnd purchMlng. Asiunt th4t you 4rc buying 
coKponcnti only from IHnlnac» you h4ve rtcouDcnded purchMing. 

0 « none 

1 « oni lor th* lnftructor(f)/counfftlor(f) only 

2 • Mvir4l to bt ihartd by itudioti 

3 • inough for Mch itudint to h«vi.hii/h«r own 

12. 4. How May Dlr«tAoni- Bookletg would you ricoMtnd purchailng If 
thay cost: (Put 4 nuabir bifori each blank.) 

$.50 - $1.00 $1.75 - $2.50 

$1.00 - $1.75 $2.50 - $3.25 

b. How meny Key Ideaa Booklete (plui Key Xdeaa Sheet) would you 
recoonend purchaetng If they coat: 

$.50 - $1.00 $1.75 - $2.50 

$1.00 - $1.75 $2.50 - $3.25 

c. Bo« May Search Booklet(s) would you racomnand purchealng If 
they coat: 

$.75 - $1.25 $2.00 - $2.75 

$1.25 - $2.00 $2.75 - $3.75 

d. How aeny Self^Aeaeaament Booklete would you reconnend purchasing 
if they coat: 

$.50 - $1.00 $1.75 - $2.50 

$1.00 - $1.75 $2.50 - $3.25 

e. How many Audlo^Tepee would you xecoamend purchealng If they coat: 
$1.00 - $2.00 $3.00 - $4.00 

$2.00 - $3.00 $4.00 - $5.00 

$5.00 - $6.00 

f . How many complete Mlnlpaca would you recomend purchasing If they 
coat: 

$3.00 - $4.50 $6.00 - $7.50 

$4.50 - $6.00 $7.50 - $9*00 



End of questionnaire. Thank you. 
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If you would not rtcoonod purchasing Mlnlpscs^ pl«ast anmer tht 
follovlng quwtlons« 



13« How would REAL hav« to be changed before you would recownend It? 
Please be apeclflc^ referring to the Mlnlpacs you examined when 
possible or approprlste« 



Probl4 



Suaeested Changed 
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14* Arc there sltuatlone for which UAL wuld h% useful? Dtscrlbe the 
sltuetlone Md hw Hlnlpece ttlght be ^nd in thtB« 



Situation 



Applicability of Mioiw 



Potential ways 
of ueiitt Mlnipacs 
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Appendix Bt 

LETTsilS TO R£VIEMERS 
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Lindsay Building - 710 $.w, Sacood Awrai* 
P«»rtl«nd. OrcQOfi 97204 ^ T«l«phon* (903) 224-3850 



Sftpt«mb«r 11 » 1975 



V% mtm currtatly cooductlnf m tmvtw of l^t4iHmt SxploraHcM in Active 
iMoming (WSAL)^ • %%t of tMourcft oiAtMl«lft concfttalns fttudrat Mlf- 
avarftDMft In ftltuatlOM which affect iMrnlng* coiiftl«t« of four- 

tftM Mtft of booklftti which Mlfttft to tmrydcy pftycho-«ocl«l conccpti* 
Tht MtftrtAlft MM d«v«lop«d by th« Northmftt BAglonal Educfttlonal 
liftborfttory and h«v« bMn uMd la high school cImcm in Vaocouvm» 
WMhtnftoa; SMttlft» WMhlnston; Portltnd^ Otftton; ttevport BMch» 
Cmllfornlft tad Tlltoa» M«v Baapfthirt* 

Wft mt% Invittnf Mltcttd tMchari from tht Honolulu mm to tttrad « 
htlfnUy MMlon to mvIkw tht mattrlAlft. Tha nunbM of rtvlimrft li 
•mil dUA to % llnitftd lu'Iiftb supply of matMlAlft; nott of tht mattrlftlft 
%T% currtntly In tht fltld* TMchMt who hav* ptrtlcipfttftd In tht 
tMtlng of MAL h«v« Indlcfttftd thtt it it potMtltlly utfftful; w» would 
Ilk* your ructions to tht Mtuialt and your parctption of wtya in 
which you could incorporttt BSAL lato your work with ttudtntft* 

EAch rtviimr will rtctiva ont %%t of tha Mtuialt (worth tbout $50) 
and ft $30 honorarium for hit/hftr htlp* In th« report of th« r«vi«w» 
which will bft difttributtd n«tion--widft» thm nMMt of tht T%vtwmt% and 
thftir ftchoolft will bt publiahtd* 

Ptrticiptntft in tht rtvitw trt taksd to tttrad % conftrtncft %t thm 
QuMn Kapiolmnl Hotftl» 150 Kapthulu Av«iuft» Honolulu^ from 9:00 ft*m* 
to ItOO p.n* Sftturdfty» October 4* During thm con£ftr«ncft» tha bMic 
purpOM of BBAL will ba briefly txplainad* Than rtviftwart will bt 
givan tiM to ax«»lna % rtftourcft aanual^ tkia all tht aatuialft^ and 
doMly asunina two aatt of oattrialft (two Mlnlpact)* Bavitwart will b« 
aakftd to «nawar « quattionnairft concftmlng thair p«rcaptioni of how 
BSAL might bft u«td in thair difttrict» how cooforttblft thty would fMl 
uaing SXAL^ and what thay ptrctivft to bt tht ttrangtha and watkntftftfti 
of thft matMialft for uat vith ttudanti* 

Information concftming SEAL ±% included to ftcilltftta your d«ciaion 
about ravlawing tha ayatam* REAL ia anticipated to b« moat uaaful 
to I*anguaga Arta and Social Scianca taachars^ aa it ia mora aaaily 
built into tha curriculum in thaaa araaa* Tou might alao consider 
thia in making a daciaion concaming your intaraat in ravlawing REAL* 
Plaaaa ratum tha ancloaad poatcard Indicating vhather or not you 
will participate* 



Wt hoptt tbmt you vlll h% ablt to partlclpatt la this rtvlw of REAL* 
Wt ballivft that It vlll bt of btatflt to you m mil ti ui* 



Slnctrtly* 



Sutaimt B* Hlicox 
Evaluation Sptclallit 



P«Mla J. Cuttinft 
Evaluation Spaclallat 
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LibOmlOry ^mM^^ 7t0 S^W. S«Cond AvtmM * Portlaod, Ortgon t7204 * Ultphont (S03) 241-6100 

Stpttvbtr 11« 1975 



tto trt ctttrMtly conductlns t r«vltw of i?tl#uant S^loraHon$ in AoHv% 
Learning (lOUDj t itt of ruourct Mttrlili cMctralnt itudmt ttlf- 
•mrtoMi la tltuntlou irhlch tff«et Ittrnlng* tXAL coMliti of fourttm 
Mtt of bookltt* wlilch rtlttt to evtryday ptycho-iocUl coiic«pti* Tht 
Mttrlalt vwt divtlop«d by tht MorthVMt Xitsloul Bducttloul taborttory 
toil hairt b««ii us«d In high icbocl clttiti In Vtncouvtr, Wuhlngton, 
Sttttlt, tteahiagton, Portland, Ortgon, Mavport Baach, California, and 
Tllton, Kair Haapahlra* 

Wa ara Invltlot ialaetad counaalora froa tha Honolulu araa to attand a 
half-day aaaalon to ravlaw tha vatarlala* Tha nuabar of ravlawara li 
aaall dua to a llaltad In-Lab iupply of vatarlali; «oat of tha vatarlila 
ara curraotly In tha flald* Cdunaalori who hava partldpatad In tha taat* 
Ini of lUUL hava lodlcatad that It li potaotlally uaaful; wa would Ilka 
your raactiona to tha vatarlali and your parcaptlon of vaya In which you 
could tncorporata SEAL Into your work with itudanti* 

Each ravlawar will racalva ona aat of tha vatariali (worth about $30) and 
a $30 honorariui for hla/har halp* In ^tha raport of tha ravlaw, which will 
ba dlitrlbutad natlon-wida, tha oaaaa of tha ravlawara and thalr achoola 
will ba publlahad* 

Partldpanta in tha ravlaw ara aikad to attand a confaranca at tha Quaan 
Kaplolanl Botal, 130 Kapahulu Avanua, Honolulu, froa 9:00 a*a* to liOO p*in* 
Saturday, Octdbar 4* During tha confaranca, tha baalc purpoaa of REAL will 
ba brlafly axplalnad* Than ravlawara will ba glvan tlna to axamlna a 
raaourca aanual, akla all tha vatarlala, and cloialy axaaina two aati of 
Mtariala (two Hinipaca)* tavlawara will ba aakad to anawar a quaatlonnalra 
concamlng tbalr parcaptlona of how iaM£ night ba uaad In thalr dlitrlct, 
how coafortabla thay would faal ualng SBALj and what thay parcalva to ba 
tha atrangtha and waaknaaaaa of tha oatariala for uaa with atudanta* 

Inforaatlon concarnlng SEAL la Includad to facilitata your daclslon about 
raviawlng tha iyatam* Plaasa ratum tha ancloaad poatcard indicating whathar 
or not your achool will ba rapraaantad in tha revlaw* 
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Wt hop« that you will bt tblt to psrtlclpttt In this rtvl«w of RBAL* 
Wt btlltv« that it will ba of banaflt to you a« vtll as ua. 



Slncaraly 



Susanna Hlacox 
Evaluation Spaclallat 



Pafflala J* Cutting 
Evaluation Spaclallat 
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7tO $,w. Second Avwhm * Portland. Or^goft 97204 * T«l«ph<HW (503) 248-e«00 

Stpttmbtr 11, 1975 



Wt trt currtotly condactltit t tinriw of Umlmwtt Ssploratum$ in AcHvm 
L$aming (RiAL)f t tMourct to b« u««d In inttrvlct trtlnlng for aduct* 
tloiial portottMl, IXAL coulttt of fourtttn sttt of booklttt vhlch rtlttt 
to ovtrTday pfxcho*Mclal conctptt tuch m fttllng duab» btlng prtlt«d« 
and iMcnlas, thm Mttrlalt mrt d«v«lop«d by tht Ivproirliif TMchlng 
CottpttuclM Protru tt tht Ndrtfamtt EtgloQAl EducttlooAl Laborttory, 

For tht tmrtWf wt trt Invltlnf ttltcttd prlnclptlt from tht Honolulu 
trti to ttttnd t htlf^-day ttttlon to rtvltw tht mattrlalt (or ttnd tt 
A rtprttutttlvt toMont lovolvtd in tttff dtnrtlopatnt tctlvltlti), Tht 
nurttr of rtrttwart li twU dut to t Italttd In^Iab tupply of Minlptct; 
Mtt of tht Mttrlalt trt currtntly in tht fltld* Your tchool hat bttn 
ttlacttd ta oM wa would Ilka to hava rapraaantad In tha ravlav. 

Each rartawar vlll racalva ona aat of tha aatarlala (worth about $50) tnd 
t $30 hooortrlutt for hlt/har halp. In tha raport of tha raylair« vhlch trill 
ba dlatrlbutad Qatloa-vlda« tha nama of tha ravlawara and thalr achoola 
will ba publlahad, 

Fartldpaata In tha ravlav ara aakad to ttttnd a conftrtnct tt tht Quttn 
Kaplolanl Hotal« 150 Kapahulu Avaiitta« Hcmolulu» froa liOO to 5:00 p,n, 
Satuidayt Octobar 4, During tha conf aranca« tha baalc purpoaa of ISAL will 
ba brlafly ascplalnad. Than ravlawara will ba glvan tlaa to axaaina a 
raaourca unual« akla all tha natarlala* and cloaaly axaalna two aata of 
aatarlala (two mnlpaca), Ravlawara will ba aakad to anawar a quaatlonnalra 
coneanliig thalr parcaptlona of how ISAL sight ba uaad In thair dlatrlct* 
how coafortabla thay would faal ualng RSALf and what thay parcalva to ba 
tha atrangtha and waaknaaaaa of tha aatarlala for uaa with ataff. 

Information coocamlng BSAL la includad to facllltata your dadslon about 
ravlawlng tha ayataa or aandlng a rapraaantatlva to ravlaw tha ayatem, 
Flaaaa raturn tha anclqaad poatcard Indicating whathar or not your school 
will ba rapraaantad in tha ravlaw. 

If you naad any furthar Inforoatlon* plaaaa call collact (503) 248-6860 
(Sua Hlacoic) or (503) 248-6865 (Faaala Cutting). 
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W€ hope that you will be able to participate In this review of REAL* 
We believe that it will be of benefit to you as well as us* 



Sincerely 



Suzanne Hlscox 
Eval'^atlon Specialist 



Paaela J* Cutting 
Evaluation Specialist 



SBa;PJC:a 
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BELEV/m EXPLORATIONS IN ACTIVE LEABNING 



Relevant Eajplorattone in Active Learning (REAL) consists of fourteen 
learning packages called Minipacs. A Minipac contains Information 
about s specific ^'psycho-social" topic and provides alternate learning 
experiences and related self -evaluation opportunities. Hlnlpacs are 
designed to help learners discover their present Ideas and behaviors 
In relation to the concepts presented In th^ Minipac. 

CoBponents of Each Hlnlpac 

•Directions . The Direction Booklet contains a sequence of 
activltes* some of which direct the participant to other 
booklets in the Minipac. 

• Key Ideas Booklet . This booklet briefly presents the 
Minipac topic in terms of important psycho-social ideas 
related to the Minipac topic. 

• Key Ideas Sheet . As a reference for participants in working 
through the Minipac^ this paper lists the key ideas discussed 
in the Key Ideas Booklet.. 

• Audio Cassette . The tape contains interviews^ confrontations » 
fantasies and misic Illustrative of the key ideas as they 
appear in human experiences. 

• Search Booklets . There sre two Search Booklets in each Set I 
Minipac. In Search I* participants define and react to the 
topic. In Search II» the participant recalls past experiences 
in analyzing his/her reactions to the to?lc. (In Set Il» 
both searches are combined into one booklet*) 

Resource Manual 

A Resource Manual has been developed to help trainers select 
actlvitiea appropriate to their training goals. The Resource 
Manual helps to iielect activities within and across the Minipacs. 

Publisher 

REAL will be available in early 1976 from: 
XIC0H» Inc. 

RFD If Sterling Forest 
Tuxedo* New York 10987 
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Appendix C: 

SYSTEMS COMPARABLE TO REAL 
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Reviewers ver# asked to name any training systuis they thought 
comparable to REAL* The following liat contains their answers. 

Transactional Analysis 
Career Awareneas 
Human Potential Seminar 
Far West 

Ettvironmental Studies 
Creating Tour Future 
HRD 

Career Success— Florida State University 
Deciaions—GBER 

Human Potential— Weber State College » Utah 

Bow to Survive in College 

Xnside^t 
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Appendix 0: 



SFADLDIN6 YOUtH CENTER STUDY 



by Ian Spencc 

Director of Curriculum 
Spauldlng Youth Center 



1 



MINIPAC PROJECT 
at 

Spaulding Youth Canter 
1975 

MINIPAC^ is an exparlnantal curriculum in Social Avarane88» currently 
being developed by the Northmat Regional Educational laboratory in 
cooperation with Xlcoa» Xnc. Xt vaa utade available to Spaulding Youth 
Center ea a epecialized teat aite» In which the curriculum could be 
adapted* tried* and evaluated by cottage teachare working, directly with 
pre^adoleacent and adoleacent* emotionally disturbed boys. Mlolpacs 
were introduced In Spaulding* a social skllle classes In Harch 1975 » and 
evaluated through June 1975. 

Setting ; Spaulding ie a private » reaidential treatment center situated 

in central » rural New Hampehire. Fifty boys between the ag«9 of 8 and 

14 live in £our» ranch-like cottages with cottage teachers who make use 

of the living situation to teach social skills through behavioral principles. 

An important part of the reeidential program is the social skills class 

in which boys and a teacher come together in an Informal session in the 

cottage at least one evening each week. Boys participate in a group 

eession which is deaignad to help them become aware of needed social skills » 

which they then practice in structured situations* Thereafter » the 

boys have the opportunity to make use of newly acquired sikllls in real 

situations which occur in the cottage and co^unlty in the ensuing weeks. 

Some of the akllle covered in theee claeaes have included *'basic principles 

of behavior analyels" (the learning of the nature of stimulus/response 

and coneequence* and how this can be used in shaping and changing behavior) » 

'^problem solving** (five steps to solving your own problem using behavioral 

techniques) » "decision making*'* *'compromlse»'* **table manners*'* *'cooklng»'* etc. 

Introduction of the Mlnlpacs ; Since one of the experimental question^ 
was how each cottage teacher would use the Mlnlpacs » they were introduced 
informally to the social ekilla teachers through a group meeting. The 
Mlnlpac packagea were made available for them to read» and they were 
aaked whether they wished to make use of them m part of social skills 
claeeea* We had previously agreed on a ceah bonus incentive for those 
teschera who wlehed to undertake a project and write up an evaluation. 
The teachere were not asked to sign up for the Mlnlpace prior to seeing 
them» ae their process of selection was thought to be important information 
about the Mlnlpacs. 

After the teachers h^sl reviewed a few Mlnlpacs and had chosen a 
pack to work wlth» they were encouraged to write up a functional curricu-* 
Imn for its uee in class. The curriculum was then introduced in one of 
the regular classes* which was observed by a fellow teacher or the project 
director. Data usually taken at social classes (raising hands* questions 
asked* positive comments by children* etc.) was taken throughout the 
Mlnlpac lessons. Anecdotal records were kept of boys* coimnents during 
the lessons. 
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Gentrallgatlon ; After each lesson^ aome data was kept on boya* uae of 
laaterlala outalde of class. Some boys were encouraged to use the actual 
Hlnlpac materials In homework assignments or project assignments, while 
other boys were overheard making statements which seemed to come directly 
from their experience In the class. Xn each case, this Information was 
recorded* 

Xn some Instances, teachers enjoyed working with the Mlnlpacs to the 
extent that they wished to do s second Hlnlpac. Where this occurred, 
the same recording procedures were used throughout. 

The Social Skills Class : The typical social skills class takes place In 
a cottage of 14 boys, with all of the boys attending In one of the comoton 
rooms, such es the living room. The cottage teacher has the curriculum 
prepared well enough that it starts with a bang and ends with a bang, and 
there are usually direct relnforcers, such as soft drinks and snacks 
directly after the class, which are earned through "on-task" points for 
paying attention during the class. The class usually takes the form 
of questions and answers about the theme topics and small, group discussions 
which come back to the main group to report. The curriculum has been well 
prepared In most cases and Is kept moving by the teacher so that the hour 
of discussion, questions, and answers goes quickly, and the boys remain 
on-task and Interested throughout. 

Results : The Hinipacs were offered to nine cottage teachers who had 
indicated an Interest in teaching social skills. Six of the nine teachers 
chose to make use of Hinipacs, and two of them worked with more than one 
Hlnlpac with their groups. A total of eight Hinipacs were taught in 
thirty-eight sessions. Being Praised was the most popular Hlnlpac (used 
by three cottage teachers). Feeling Dmb and Being Inftmnaed were both 
used twice. Seeds and Desires and Being Helped were used only once. 

Reasons for Choice : 

* 2 
(1) Being Praised: Teacher C (boys, aged 6 to 10): 

"After reading the Key Xdeas Sheet to all the Hinipacs, X narrowed 
my choice of lessons to 1) Being Helped or 2) Being Praised* The main 
consideration in this decision was the functional level of the boys to 
whom the Iftsson would be taught. Xn this case, the boys Involved were 
ages 9-12 ytara, but functioning at about a second to third grade level. 
With one exception, sll the boys had especially low verbal skills. Hence, 
it seemed prudent to select a Hlnlpac which would not require sophisticated 
verbal skills or introspection. With this in mind, X considered both 
Being Helped and Being Praised. 



"Since in the past X taught several currlculums in ^helping* others, 
X seriously considered teaching the Being Helped Hlnlpac. But the emphasis 
in the Hlnlpac seemed to be on reactions to being helped, the need for 
Independent work and the difficulty in asking for help. These needs and 
feelings were certainly beyond my audience. Xn the helping currlculums 



2 

Teachers' names have been eliminated and replaced by letters. 
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I taught » the key Ideas were how to ask someone If they wanted your 
help* and how best to help. Helping was presented as always desirable 
and positive because It makes the other person feel good* The boys 
latched onto this Idea. The Intent was to Increase the frequency of 
their helping behaviors. I did not feel they were ready for an expanded 
notion of helping and being helped. 

"Thus* I opted to work on Being Praised* It seemed to be especially 
relevant to a population of behavior problem boys and potentially 
tlierapeutlc. That Is* a high frequency of negative behavior which boys 
at Spauldlng emit Is peer provocation. Praising behavior Is an extremely 
low frequency behavior among boys at Spauldlng* especially pralalng of 
peers. If one could increase the boys' rate of praising others* It could 
serve as In Incompatible response to provoking others* In sum* It was 
the Idea of praising that led me to choose the Being Praieed Hlnlpac*** 

(2) Being Praieed: - Teacher B (boys* aged 10*12): "The Hlnlpac was 
chosen because of boys* Indicated need* They typically do not praise 
either peers or adults.** 

(3) Being Praised: Teacher A (boys* aged 12'^14): No comment. 

(4) Being Influenced: Teacher D (boys* aged lO-^lS)! "We chose 
Being Influenced Hlnlpac because It was the most relevant one left 
after doing Peeling Dwnb and HeedB ccnd Desires*** 

(5) Being Influenced: Teacher E (boys* aged 12-14): "The Mlnlpac 
on Being Influenced was an appropriate lesaon for the boys at Fott^^r 
Lodge because the most powerful relnforcer for that age group Is peer 
pressure or attention* This Immediate need for friendship and belonging 
often takes precedence over their longer term desires or needs*** 

(6) Peeling Dtonb: Teacher D (boys* aged 10*^12): "Because many of 
our boya are from unuaually deprived backgrounds* many of them have a 
poor self-^lmage and are very aensltlve to failure* I felt that this 
Mlnlpac could help them by teaching them the discrimination between 
when they should feel that they did a dumb thing and when they shouldn*t 
feel dumb. The boya In our program are very competitive with each other* 
and I wanted to emphasize to them ^en they shouldn^t feel dumb Juat 
because someone else la better than they at something." 

(7) Peeling Dwrtb: Teacher E (boya* aged 12-14): **Peeting Dwrib 
Hlnlpac was a very appropriate curriculum for the boys In Potter Lodge 
for the following reaaons^ 

1. Host of the boys do not feel very good ^bout themselves 
and have poor self-concepta. The boys needed to learn 
how not to feel so dumb for common errors. 

2. Accent needed to be placed on ability to learn feeling 
dumb altufttlons as a learning experience. 

3. I felt that it would add greatly to the cottage program with 
boys helping each other with their feelings.'* 

(8) Being Helped: Teacher P (boys* aged 12-14): '*Hany boys at 
Potter Lodge are resistant to being helped by staff and peers due to 
a lack of understanding in being helped skills. This greatly reduces 
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the amount of help that thay racalva from a vary willing and halpful 
ataff . Being Hglpgd waa Important In facilitating a cooperative and 
truatlng relatlonahlp between boy and ataff during tlmea when help la 
needed. For thl| reaaon, Being Helped was chosen aa moat helpful for 
Potter Lodge ataff and boys/* 

(9) Seed$ and Deeiree: Teacher D (boys, aged 10-12): chose 
this curriculum because It contained a clear-^cut concept X could teach 
the group. X elso felt thet a discussion of needs and desires was vary 
appropriate to thla age group and population. Having the boys take an 
active part In planning their futures has been very difficult. X felt 
thla curriculum might encourage the boys to think about what they need 
to make them happy aa well ea give them a working vocabulary with which 
they can discuss these aattera.** 

Materlela Used : As Table A shows, the Key Xdeas Booklets were the moat 
popular Items In the Mlnlpacs. These were used by seven out of eight 
curriculum writers with the exception being Teecher F who did not use 
the Key Xdeas Booklets In his Being Influenced groups. The Key Xdeas 
Sheets » Search Booklets, and the tapes were the next most popular Items. 
The games were found useful by five out of eight curriculum workers. 

The Self -Assessment Booklets were used In part In three different 
currlculums; Feeling Dwrib, Being Praised and B^ing Helped. 

All of the people using the Mlnlpacs developed their own lesson 
plans to considerable detail. The Directions for Group Use were not 
found useful. 

Lesson Plans : Lesson plans were prepared by and large according to the 
functional curriculum formula used at Spauldlng Youth Center. 

Data Taken During and After Classes ; As Table B Indlcatea, the class 
size ranged between 3 and 14 boys. The number of aesslons per Hlnlpac 
topic ranged from two to five. The iiK>st popular pinpoint on which data 
was collected was ^^posltlve questions or statements,*^ which was paired 
with ^^off'-task behavior.*^ Workaheets were often used as vehicles for 
learning and data» aa were pre- and posttests. 

Xn general^ the on-^task behavior Indicated by high frequency of 
positive questions and statements was at a high level lii the aodal 
akllls classes. Figure 1 shows the frequencies and trenda of poaltlve 
statements, and off^task behavlora^ In six Mlnlpac classes and five 
subsequent sex education claases conducted by Teacher D with 12 or more 
boys. In all of the classes, positive responses ranged between one avery 
two minutes to more than one per minute. Off^task behaviors ranged 
between one and four every ten minutes. The Introduction of each new 
Subject brought a decrease In positive responses followed by an upward 
trend In each case. Xn the third lesson of the Feeling Dumb series^ 
Teacher D Interwove the lesson with problem solving techniques that 
the students had previously learned to use, resulting In a continued 
Increase In responses by the boys. Xn subsequent lessons » Teacher D 
continued to use reviews which may account for the continuing upward 
trends . 
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Use of lesoucces 1 tovled in the Hlnlp^cs 



Title of 
Minlpac 



Teechec 



ty Idees 

Sheer 



Key Ideas 
Icolilec 



Search I 
fiooklec 



Seeich II 
feochilec 



Dlcecclofts 



5e 1 f -AsseewMi v 
Booklet 



Tep— 



Hecerlsls Developed by 
Eech Tesclier keecd On 
Mlnipec IKitllne 



2i 



Teechec A 
Teacher B 

Teacher C 



V«e 



Tes 

yhet Is 

P»lse? 

Effects of 

belns 

praised 

Yes 



Yes 



I^p.l 



Yes 



Tee 
Yes 



Yes 



Cscds 



lesson Flea 

LesBOfk Pise 
Individual Cbotr^cc 



Lesson Plan 
Praise Tap* 



e 



Teacher B 



Teacher 6 



#9 



Person 4 
arrows 

figure I 

Person 4 

srrows 

figure 



Lesson Plsn 



Siruerion Idenrlficarlon 
Figures 
Lesson Plan 



e Q 



Teacher B 



Teacher 6 



Useful 

: 75/6/8 



tseful 



Useful w/ 

MOdifi* 

car ions 
Useful 



3/4/5/6 



adspred 



Acrlvlry 
#3 



#5 



tes 



Gi 
hopper 



Lesson Plan and Gaae 



Grasshopper Ca«e and 
Slruation Idenrl fleer ion 
Sheer 



Teacher F 



Ves 



Csrroons 
last pag« 



All 



Yes 



1/2 



Yes 



Tes 



Lesson Plan 
Field Trip 
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Teacher D 



J/2/3 



Yes 



Satis- 
fscrlon 



l)u«srlonnalre Bookler 
on Topic larervisvs 
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11 tU of 



Is 



SivMry of <o«irc«« of DbCa 



Tucber 



Toacber 



13 



U 



6 
4 



U 



DMcrl^tlOR of T«ot 
ObMnMitl«»« or 
QuMttovMlM 0oo4 
to Colloct DOC4 



ir of q«iostlo«s 
aooif*To4 corroctlT 
io ««*ioct 

Oa/off toflc 
MuiWor 
<Woff i:uk 
bobavlor 

■oy'o of 
MOtbor boy 
outoldo of clooo 



<Woff tr^k 
bobovlor 

Iodl¥ldllttl ittf 1IMC4 
Ittdlvldivl Ittf llMC< 



SI tiumttomm t «fao«il4/ 
«houl4a*t fool 
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Five of the lessons led to some work being done outside of class 
by students. A total of 12 students participated In out-of-class 
contracts . 

Apart froa the contracts done outalde of class by boys generalization 
outalde of class was noted In only a few cases* and some of these 
situations were picked up In anecdotal notes. 

Teacher D noted the Influence of the Being Influenced Mlnlpac lesaons 
on one boy In her cottage. **on one occealon, I found It useful to 
refer beck to the class when I was working with one of the boys. The 
boy has a reputation for not coming back to Spauldlng Youth Center after 
he visits home. His peers have been reinforcing him for this. This 
boy had to go home for a few days. Before he hed the opportunity to 
tell his frlenda he was leaving, I proposed the Idea of keeping It a 
aecret so that they wouldn*t Influence his behavior. He egreed to the 
experiment and returned on time two days later. There were many factora 
as to why he returned on time but the Influence experiment may have helped. 

On another occaalon when during the Feeling Dumb Mlnlpac, one teacher 
noted, **Three days after the Feeling E>wib class, the boys were comparing 
achool scores. One boy referred back to the cless end said he did the 
best he could on the tests and that he shouldn*t feel dumb. This remark 
came from a boy who generally had difficulties grasping materiel In clasa 
and tremendous .difficulty In controlling his competitiveness." 

Impressions* about Specific Mlnlpaca from the Mlnlpac Users : 

1. Being Praised: Teacher A. **My results Indicate that the 
Mlnlpac "us'ed wa^ a good tool In helping 12 to 14 year-old boya learn 
the concept of nralae. However, modification did have to be made. 

" Evaluation ; All four boya have mentioned to me In outside discussion, 
*Hey, you just praised ma,* or *I pralaed him just now, dldn*t I?* 
They felt Important and mature about being able to understand and deal 
with prelse as they see It. 

**The small group enabled much one*to-one work which the boys find 
reinforcing. They all listened and were listened to. That makes them 
feel worth something and makes learning fun rather then a chore. 

feel that the boys have reelly learned something applicable to 
their dally lives. Using the concept of praise each day end being aware 
of what they feel, getting In touch with themselves. Is the most valuable 
lesson I feel they have learned. 

"I like the Mlnlpac Idea In a small group session. ^It made the 
evenings not only learning experiences but pleasurable and productive." 

* 2. Being Praised: Teacher 6. **The class did seem beneficial In 
that It forced kids and Instructor to look at praise. Its underlying 
values. Important people In our lives, how praise Is delivered, and how 
praise affects our behavior. The kids were able to communicate their 
feelings about praise and people who praise them. Generally, at. this 
Center, It Is felt that praise Is important to use in shaping kids* 



80 



85 



posltlv« bahavlort; the higher the rate» the better the change. It became 
clear that moat of the older» more ^together* kids placed more value on 
one» well-^tlmed pralee than on a hundred of the typical *Gee, you look 
swell today.* type praleea. 

'*The claeeet were of pereonal Importance to the Inetructor. Bis 
pralelng was more dlecrete and attempte are being made at making It 
lese typical In nature. It made him more aware of hie own value eystem 
ao that he can now eay thlnge like *Bob> I*m glad to see that you^re 
dressing neatly. ..It telle me that you like yourself more.* 

^'Although the claes waa weak on ehowing If there was any change > 
subjectively the Instructor feels closer to *vhere the kids are at* and 
In their own way, they*ve become closer to him.'* 

3. Being Praised: Teacher C. '*In sum» my curriculum was much too 
broad. A elngle Minlpac haa enough material for five to ten lessons 
when taught to a young population ae was the case here. A good Indicator 
of the functional level of the boys Involved Is that none of them knew 
what the word *pralse* meant» although they understood It once I defined 
It. 

*'The most valuable parts of the Minlpac on Being Praised were the 
auggeetlons to use a tape (make a praise tape)» and rate pralae statements 
(either for quality or sincerity). The brief tape made by the class Is 
enclosed. It Is noteworthy that It was the fourth recording. 

**As with meet every social skills class, the boys did return to the 
cottage after clasa» repeating a few pralae etatements with enthuslesm. 
The individual contracte were aet up with this same enthusiasm. The 
boya were earning everything from kites to radioes selected by them. 
They needed to meet a certain frequency of praise stetements during a week*8 
period. The individual criterion levels were set on the baala of previous 
aoclal skills earning contracte. But the criterion levela were too high 
for the behavior of praising. The data shows that somewhere* between 10 
and 15 might have been a better criterion. (Of course » if the curriculum 
had been taught in smaller steps over many weeks » the criterion may have 
been met towards the end of the curriculum.) 

**Another reason for lack of generalization may have been the absence 
of proper etlmull for praising behavior. For example^ the mesl table 
aerves aa a stimulus for polite eatings but the only stimuli for praising 
were the altuatlons we role played in claas, and verbal cues to 
individual boys in the form of *How are you doing on your praising?*. 

**The overall effect of the curriculum was a temporary increase in 
the rate of praise statements. This is subjective data» as no baseline 
data was taken. However^ in my 16 months of work with this population, 
I can remesiber few» if any» Instances of praising peers. Peer provoca* 
tlons^ as recorded dally» showed no decrease during or after the two 
currlculums. Even if a decrease was evident » however, this would not 
be reliable data as there are many variables affecting this measure. 
The temporary Increase was most likely due to the curriculum. There 
was an Initial enthusiasm for earning the chosen reinforcer which faded 

86 

81 



Qvtr time (probably as tha laamers realized the Imposelblllty of 
thalr task). But the data does shew that praising did occur during the 
week. 

. 

**Tha Mlnlpac curriculum could serve as one of several resources for 
social akllls In the cottage. It is definitely geared towards a young 
adolescent population^ however. Its greatest value as a resource seems 
to be the IdeaH it^'offers^ many of which could be developed Into 
currlculums themselves. I would have preferred that the Mlnlpacs be 
connected to one another mc*e In content than In style." 

4. Being JOifluanced: Teacher D. **I felt that this was a needed 
eubject for the boye. But I could not find concrete demonetrations 
suggeeted by the tUnlpaca. One of the weaknesses of my flret leeeon 
waa that It was totally dlacusslx>n» no role plays or games. The boys 
were not too enthualaatlc about the topic. In between the first and 
second leseons^ I did some Individual work with a few boys. They each 
filled out a diagram aimllar to the one used in the first claae. We 
then individually dlscusaed each Influence and attempted to differentiate 
between etrong and weak Influences and good and bad Influence. I was 
very pleased with the boys^ results. The second class was also more 
pleaaing. The boys ware anthuslastlc about filling out the Being Influenced 
diagrams even though they often complained in order to avoid doing 
written work. I did not hear any complaints about filling out the diagrams. 
The boys had difficulty saying what Influence means^ but their answers 

on the diagrams atteeted to the fact that they understood the concept. 
The finished diagrams provided insight into the boys and their seeing 
each others* influence on them. 

"If the Minlpac had been limited solely to the Key Ideas Book and 
maybe one Activities Book designing a curriculum based on lt» it would 
not have appeared to be such an aweaome task." 

5. Being Influenced: Teacher E. No direct comments about the 
Minlpac Itself. The teacher made use of ideas gleaned from the Mlnlpac 
to work up his own curriculum (Influence from people and the environment^ 
external and internal influenced^ good and bad Influenced). 

6. Feeling Dwrib: Teacher D. "I found the Key Idea Sheet to be 
very useful. I Incorporated several Key Ideas into the class. The 
Key Ideas Booklet was useful in exploring the theme of Peeling Dumb but 
I had to make major modifications. I thought the Peeling Dum was an 
attractive idee but the examples weren't relevant to our populetlon. I 
could have adapted it by changing £he situations on the cards^ but I 
dldn^t attempt lt» because I found other material to take higher priority. 
With the exception of some of the Self ^Assessment Books^ the rest of the 
material proved too difficult to work with. The concepts seemed too 
vague to teach to this population^ and examples dldn^t seem relevant. 

'*When I approach writing or using a curriculum^ I attempt to teach 
a new skill. In the first class^ I concentrated on the skill of analyzing 
a * feeling dumb' situation. I taught guidelines^ and the skill was easy 
for them to master. I used this method because with my population^ 
they seem to retain longer if they have something concrete to refer back 
to. I spent about four hours sketching possibilities for the second 
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class. After that period of tlme» I aettled for teaching the hoys in 
constructive response. Xhla was the moat concrete ak^^ll I could pull 
fron the Mlnlpac. In retroapact» I think this was too difficult a aklll 
for theae boys to master. A weak after the class » I asked some of the 
boys what ve had done the previous veek» and they were ,not able to remember. 
This Is unusual. 

"I spent about 12 hours total preparing for the two classes. This Is 
almost double what I normally spend. One'factor In the Increased time 
was that I wanted to do a good job In testing the Mlnlpac» but I don*t 
think this was the main factor. A large part Is that the material Is 
very sophisticated. I felt It was so subtle and sophisticated that It 
would only ba a highly motivated person that would work through a 
Minlpact retain » and apply the knowledge. It ia the retention and 
application of concepts that I am most concerned with in my age group. 
Although I personally found the Feeling Diarb Minlpac to ba interesting* 
fw parts of it were memorable and it did not affect my own personal 
behavior . 

**A strength of the Feeling Dwtib Minlpac is that the subject matter 
applies to a wide range of people. The topic was very relevant for my 
class. I doubt if I votild have ever had thought to work with the subject 
if it had not been for this curriculum.*' 

7. Feeling Dwtib: Teacher E. **Uslng tht Hlnlpacs as a reaource* 
I designed a grasshopper game (straight out of the tape) which required 
that each boy respond with a rationale for feeling dumb in a given 
situation. A *feeling dumb* akit was enacted by two boys* after which 
directed discussion elicited several personal examples from the boys. 
Through a structure provided by ^Situation Identification Sheeta/ the 
boys investigated Intensity of feeling* their usual reaction^ and the ^ 
opinions of the other boys. The resulting Immediate feedback was of 
Interest to the boys» and I think it was a dynamic leamin:^ experience 
for all." 

8. Being Helped: Teacher F. "In this package* I used tha Minlpac 
tape. The music was great; enjoyed by all the boya. The Key Ideas Sheets 
and Booklets were used. Theae proved to be quite successful* especially 
the lllustrationa and cartoons which alona provided enough atlmull for 
learning and having fun. Mora of this please." 

9. IfeedB and Desires: Teacher D. "it is too early to tell if 
there is any long lasting effect from Seede and Desires classes* but 
I have seen some vary positive short term effects from the class. I 
worked individually with three boya. I found that given the vocabulary 
they learned in class* ve were better able to communicate about some 
very important subjacta. Hearing their answers in class haa given me 

a great deal of knowledge about them. Identifying their needs and desires 
appears to have beneficial effect on at least one of tiMse boys. This 
boy had been very aiibivalent about certain needs and desires and judging 
from his behavior in a few dlscusalona* he seems to have a clearer idea 
of what he wants." 
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General Impresalona : 



Teacher D: ^'My reaction to the Hlnlpaca Is a very mixed one. I 
was pleased with the final results of my classes but the amount of time 
needed to prepare the classes from the Mlnlpacs was excessive. In both 
sets of Mlnlpacs, Feeling Dwtib and Seed$ and Desires ^ my preparation time 
ran roughly double to what It normally does. 

'*When I first received the Mlnlpac, I spent about three hours loolclng 
them over and perhaps two to three more before a lesson plan took shape. 
If I hadn't contracted to evaluate th«D, X would have given up after the 
first hour and a half. The main problem I had with them was that there 
are just a clear~cut functional concepts in each Mlnlpac. The Key 
Ideas Sheets were very useful as well as parts of the Key Ideas Sooklets. 
I felt that the rest just rambled on. 

'*I found the topics explored to be very relevant to this population. 
I was Initially hesitant to try such sensitive topics with this group, 
but I am very glad that I did. If I was planning classes for a new group 
of boys, I would make use of these topics again. 

'*The boys* participation In the Mlnlpac classes revealed some very 
Interesting Information about themselves. I felt that I had gained more 
knowledge about these boys In the four Mlnlpac classes than In any other 
four social skills classes. 

"I would like to see a radical change made with the Mlnlpacs because 
they are not very useful In their present form. The value lies In the 
topics and the Key Ideas Sheets. My suggestion would be to produce small 
Mlnlpacs that contained a Key Ideas Sheet and one concise booklet (along 
the lines of the Key Ideas Booklet but Including a few suggestions as to 
how to present this material In class). The emphasis could be In offering 
many Interesting topics with concise key Ideas as opposed to doing a vague 
rambling set of booklets on one topic." 

Teacher F, Program Coordinator and the Project Director: "The five 
Mlnlpacs used by our curriculum people provided a very useful stimulus. 
None of the social skills group had touched on any of these subjects with 
their classes, and were skeptical at first that these subjects were 
relevant to these students. Once they worked on their own curricula and 
found the students lacking In awareness In these seemingly simple concepts, 
they found that there was a whole new bag of learning for everyone. The 
results has been a new Interest In social skills curriculum and an Interest 
In returning to Mlnlpacs once they have completed the sex education sequence 
that they are presently working on with students. 

*'The Mlnlpac materials were presented In such a way that they did 
not cause the teachers to come up with stereotyped curricula. Each 
curriculum was an original piece, stressing different aspects of the 
topics, which the curriculum writers strlved to Individualize to meet the 
needs of their particular cottage groups. 

"The results are a richness of medium. Some people enjoyed the tapes, 
some enjoyed the games, $ome enjoyed the Ideas that they were forced to 
think about.** 
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PREFACE 

Thlfl publication la ons of a series of aumnary evaluation reports 
Issued by the Northwest Regional Educational Laboratory to document 
evaluation findings for selected products* The subject of this report 
Is Relevant EaigloraHcm in Active Learning (SSAL), an instructional 
resource developed In the Improving Teaching Coopetencles Program* 

This report sumsrlxes the date collected about the use of SEAL In 
terns of strengths and v«eknesses of the naterlals. It also focuses on 
the effects of REAZ participation on students and adults. The infotma* 
tlon Includes perceptions of potential users cancemiug audiences as 
well as the strengths and weaknesses of REAL and aummarlxes how SEAL 
was used at a residential center for boys* 



Lawrence B* Fish 
Executive Director 
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mnuoDUCTiON 



The following ia a sumnary of the Relevant Bxplcratiom in Active 
Lecaning (SEAL) Users* RevietJ and Case Study^ prepared by the Xmproving 
Teaching Competencies Program (XTCF) of the Northwest Regional Educationsl 
Laboratory (NWREL). The reader ia referred to the full technical report 
for detaila of the sanpling procedurea, Instrumentation and data analysis 
proceduras used in these studies. 

Relevant Explorations in Active Learning (SEAL} waa one of aeveral 
instructional ayatems developed for maaa distribution by the Xmproving 
Teac Ing Competencies Program of the Northwest Regional Educational 
Laboratory. Fourteen learning packages called Minipaca were developed. 
A Minipac contained information about a specific "psycho-^aocial" topic 
and provided a variety of learning experiencea and self^evaluation oppor- 
tunities related to the topic. According to the developers, each Minipac 
was aimed at helping the participant understand and know what the aelf 
waa becoming. 

The Minipaca were titled: *'Feeling Dumb," "Getting the Meaning of 
the Message," "Keeping Track of Time," "Being Influenced," "Being Helped," 
"Being Praised," '^Identifying Hy Needs and Desirea,** '*Why Learn Anything?" 
"Keeping Open to Leaxning," 'Xeaming on Your Own," '^Letting Someone 
Teach Tou,*' "Strategies for Learning," "Knowing Your Own Learning Style" 
and "Learning by Confrontationa." 

^Cutting, P. J. and S. B. Hiacox. Relevant Explorations in Active Learning 
(REAL) Users* Review ccnd Case Study. Portland, Oregon: Northwest 
Regional Educational Laboratory, Xmproving Teaching Competencies Program. 
1976 
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There were four versions of each Mlalpac: student Individual, 

student group, adult Individual and adult group. The Mlnlpacs contained 

the following components: Directions Booklet, Key Ideas Booklet, Key 

Ideas Sheet, audiotape cassette and Search Booklets. In addition, a 

2 

resource manual for all of the Mlnlpacs was developed. 

SEAL was developed for use by high school students and by elemen- 
tary and secondary school educational staff. Including teachers, adminis- 
trators, counselors, and paraprof esslonals. Student versions were 
designed to form part of a classroom curriculum or to act as counseling 
or guidance materials. For staff, SEAL was Intended as a resource for 
Inservlce workshops or Individual exploration. 



2 

The audiotape cassette and the resource manual will not be available 
for purchase. 
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USERS ^ REVIEW 



The us«rft^ review focused on perceptions of potential consumers 
ati>ut how they would use the REAL materlela. 

SUBJECTS 

Six groups of subjects from three sites (Portlend, Oregon; Salt lake 
City, Utah; and Honolulu, Hawaii) were solicited to participate In the 
review of REAL^ From each of the three sites, principals or someone 
concerned with staff development were asked to review the adult Mlnlpacs. 
The student verslone were reviewed, at each site, by teachers and 
counselors In secondary schools. 

Potential participants for each site were randomly selected from a 
listing of public school principals, secondary teachers and counselors. 
Since Honolulu has e number of private schools, principals and counselors 
from the private schools were ir^iluded In the sample (a listing of pri- 
vate school teachers was not available). Letters requesting persons to 
psrtlclpate In the review were sent to 30 principals as well as to 70 
teachers and counselors (combined) at each site. The letter sent to 
school personnel In Portland, the first review alte, originally promised 
all fourteen Mlnlpacs but no honorarium for reviewers^ participation. 
Due to the Inadequate number of people agreeing to review REALy however. 
It was decided to offer the Portland participants the $30.00 honorarium 
plus seven Mlnlpacs. The potential reviewers were notified by telephone 
of the change. An additional ten names from each group (teachers, coun- 
selors and principals) were randomly selected and asked to participate. 
Reviewers et Salt Lake and Honolulu were Initially offered an honorarium 
of $30.00 plus seven Mlnlpacs. 



The Portland review, held at NWREL oa September 13, 1975, Involved 
eleven reviewers of the student materials and eight reviewers of the 
adult version* The Salt Lake City review, held in a motel conference 
room on September 27, 1975, Included fourteen reviewers of the student 
Hlnlpacs and ten reviewers of the adult materials* Twenty*four persons 
examined the student materials* and seven reviewed the adult materials 
In the review held October 4, 1975, In a Honolulu hotel conference room* 

Reviewers of both versions (student and adult) of the Mlnlpacs were 
asked to coionent on the readability of the materials* Overall, the , 
reviewers found the materials **generally easy to read and understand*" 
However, the adult version was rated more readable than the atudent 
version* The most frequently listed criticism of the materials referred^ 
to the vocabulary and jargon In the text* Seven adult version reviewers 
and sixteen student version reviewers listed this criticism* The evalu- 
ators recomnended the student version of I^AL receive considerable text 
editing before final production to eliminate the jargon as well as 
difficult vocabulary and to clarify the directions* 

STRENGTHS AND WEAKNESSES 

J Reviewers were asked on the review questionnaire to evaluate the 

system^s strengths and weaknesses In rhe following areas: 

1. Appropriateness of content for students and staff 

2. Amount of Interest to students and staff 
3* Materlal*s structure and format 

4. Probable effects on students and staff 
Reviewers of the adult version Indicated that the content was 
appropriate , good and well organized although the generality of the 
content and the time required to complete SEAL were each Indicated as 
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weaknesses by two of the reviewers. For the student version* the most 
frequently listed strength was that the system was realistic and relevant. 
Among the waaknesses listed were: It was too structared* It was better 
for older studcnts^senlor or posthlgh school^^and some Hlnlpacs were 
too elementary for high school. Other Mlnlpacs were deemed too 
Intellectual. 

Reviewers of the adult Mlnlpacs Indicated strengths in terms of 

their high interest to staff menibers and the amount , of ^^human Interest. 

Other reviewers felt that Mlnlpacs were weak In terms of interest because 

too much depended on the perceived need of the learner. The student ver* 

slon reviewers commented on the strengths of Mlnlpacs In* that the materials 

were of very high Interest and were relevant and needed. Reviewers 

commented on weaknesses of the system In terms of Intere^Jt: the Mlnlpacs 

* 

took too long to complete* some of the titles were too academic and 
uninteresting* and< the materials were too difficult for slower students. 

Reviewers cotmnents on the adult Mlnlpacs Indicated the structure 
was good and the materials were easy to follow; comments about weaknesses 
In structure of the adult Mlnlpacs Included suggestions that the materials . 
be combined Into one volume or that the materials form two volumes: 
individual and group. For the student version* the listed strengths of 
the structure Included the Incluslveness and planning of the materl&ls 
and the clarity of Instructions. The perceived weaknesses of the student 
version's structure Included: the number of packets* the number of 
^Vonsumables^* and unclarlty of directions. 

Adult version reviewers commenting on the strengths of the probable 
effects of the system felt that Mlnlpacs helped to develop Insights Into 
one's own and other^s feelings. However* reviewers saw the materials as 

5 
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requiring a high degree of self ^motivation. For the student version, 
the majority of the comments dealing with probable effects concerned 
students* personal growth and their Increased social and self'^awareness. 
Perceived weaknesses were centered on the need for more Indepth materials, 
the need for some kind of followup and the possibility that system may 
turti off low achievers. 

Regarding the resource manual, ten of the adult reviewers Indicated 
the manual was useful or very Inclusive; nine reviewers saw It as the 
"poorest part of the program" and **redundant and tedious to read." 
Similar strengths and weaknesses were listed by the reviewers of the 
student version. Eleven student version reviewers listed a strength of 
the manual and twenty^three listed a weakness. 

KECOHHENDED PURCHASES 

Reviewers of both versions wxe asked whether they would recommend 
purchase of at least one Hlnlpac. All but one adult version reviewer 
would recommend purchase of a Hlnlpac. The characteristics of REAL that 
most frequently led reviewers to recommend their purchase were: the 
emphasis upon self^awareness, the flexibility In the use of REAL as a 
resource, the choice between group or indivi d ual learn ing and the 
emphasis upon psycho-social concepts encountered dally. 

The most frequently recommended Minlpac was "Feeling Dumb*" Other 
highly recommended Hlnlpacs were: **Belng Influenced," "Learning by 
Confrontations" and "Identifying My Needs and Desires." The component 
least frequently recoflmiended for purchase was the resource manual. 

Reviewers were asked to specify the quantity of each Mlalpac 
component they would recommend for purchase at prices designated In the 
questionnaire. In general, reviewers Indicated that they would purchase 



larger quantities of Hlnlpac components at th« lower price ranges* The 
evaluators recommended that th« Mlnlpacs be sold separately rather than 
as complete -sets and that the prices for the Mlnlpacs should be as low 
as possible* 

The majority of the adult version reviewers would use REAL with all 
ataff members* Likewise^ the majority of the student version reivlewers 
would use REAL with all students* 

USER GOALS 

Reviewers were given a list of possible goals for the use of SEAL* 
Host of the revlevera Indicated that they would use REAL to create self- 
awareness among students and staffs to help students and staff examine 
the way they act with others and (for the student version) to help 
students take reaponalblllty for their own learning* 

Partlclpanta were asked whether there was a specific goal for their 
class or staff development program that i^AL might help to meet* Creating 
self-*awareness among studenta and staff was the most frequently mentioned 
goal REAL m£ght help to meet* Group discussion was the most often 
recommended means of Incorporating REAL Into staff development programs 
and classroom work* 



CASE STUDY 



In April 1975, NWREt contracted with the Spauldlng Youth Center of 
Tllton, New Hampshire, a residential private treatment center for boya 
between the ages of 8 and 14, for the use of REAL Set X Mlnlpacs. The 
Center agreed to use REAL in social skills classes presented In the 
residential cottagee at the center. Mlnlpacs were informally presented 
to nine cottege teachers. A cash bonus Incentive was offered to teachers 
using Mlnlpacs and six of the nine teachers chose to use them. These 
teachers reviewed several Mlnlpacs, then chose Mlnlpacs to use In a 
eodal skills class. The Mlnlpacs formed the basis for the class and 
were modified as aece&aary. 

The Mlnlpacs used In the classes were: '*Belng Praised'^ (3^teachers) , 

**Feeling Dumb" (2 teachers), *^Belng Influenced" (2 teachers), "Identifying 
My Needs and Desires*' (1 teacher) and "Being Helped** (1 teacher). The 
selection of Mlnlpacs was based up<m the teacher's analysis of nhe boys* 
psychological needs and/or the Minlpac^s content, which hopefully would 
help alleviate problems In working with the boys. 

Teachers generally used selected parts of the Mlnlpacs. Key Ideas 
Booklets were used In teaching eight of the nine Mlnlpacs. Key Ideas 
Sheers, Search Booklets and audiotapes were used next most often. Games 
were used for five of the nine Mlnlpacs* Directions for Group Use were 
not used. 

Teachers^ reactions to the Mlnlpacs were somewhat mixed. Most 
teachers fell: the classes had gone very well and that both they and the 
students had learned from the lessons* Soine teachers, however, were not 
as happy with their use, noting problems in their presentation of the 



material or the task. Most teachers felt the Mlnlpac Ideas were worth- 
while and relevant. At the same time they reported being overwhelmed 
by the number of suggested activities and a need for more time than 
usual to develop lessons based on the Mlnlpacs, 

Observations of the boys In a limited number of classes Indicated 
a high degree of ontask behavior. Observations of boys outside of class 
did not show lasting observable effects of the class. Several teachers 
reported anecdotal Information^ hovever» which reflected the Mlnlpac 
topics. Several teachers also reported personal feelings that the 
Classes had affected some boys. 
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